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I. INTRODUCTION 


A. PURPOSE/PROBLEM STATEMENT 


According to the Reform of Defense 2020 plan, the Ministry of National Defense 
(MND) seeks to construct a high-tech military that can reduce overhead cost and improve 
productivity. The KVA methodology can measure both of them. 

The MND has implemented RFID technology at seven Ammunition Storage 
Warehouses (ASWs) and five Air Force Supply Depots since October 2004. Over the 
past five years, seven ASWs and five Supply Depots have implemented RFID technology. 
However, the problem is that there are no objective ways to determine the Return On 
Investment (ROI) of RFID. 

Over the past few decades, there have been many attempts to estimate the cost 
benefit of these kinds of technologies. The most representative method of Performance 
Measurement Tool (PMT) is the Balanced Scorecard (BSC) based on critical success 
factors and key performance indicators. The MND has referred to Jung’s (2007) paper of 
the Korea Aerospace University (KAU) using the BSC to estimate the performance 
improvement on implementation of RFID. However, the journal Performance 
Measurement Association (PMA) believes that the failure rate of this approach is around 
70%, which begs the question of the viability of measurement of RFID for the MND (H. 
Counet, 2005). 


B. BACKGROUND 


For many years, the United States has had problems with tracking and identifying 
inventory during combat operations, most recently in Operation Iraqi Freedom (OIF), 
incurring an average loss of $3.5 billion. 


In OIF, nearly forty thousand containers from hundreds of different 
suppliers, contractors, vendors, and the Department of Defense itself found 
themselves placed in massive battlefield supply depots. In Saudi Arabia 
alone, 6.5 million tons of equipment arrived in-country. Those forty 
thousand containers arriving in theater created a time- and manpower- 
intensive job as inspectors were forced to empty and repack container after 
container in search of the parts that they required. More than half of the 
containers were never opened and left in the “Iron Mountains” of 
1 


containers stacked up outside the ports. This lack of control of the supply 

system caused commanders to order the same parts several times, and in 

Operation Desert Storm resulted in $2.7 billion dollars worth of parts 

going unused and sitting in the Arabian desert for months and sometimes 

years (Jones & Davis, p. 229). 

The MND has the same problem. The MND has implemented the Defense 
Information System (D.I.S) for military asset visibility since 1996. However, the RoK 
logistics had suffered from wasting money due to excess demand that came from the 
ignorance of the amount of inventory and military items stored in the warehouse (Alan, & 
Steve, 2004). 

RFID implementation is one of the solutions to eliminate this problem. This new 
technology promises to reduce the cost of war, as indeed RFID is regarded as the most 
powerful logistical system in the private sector, and in public organizations such as the 
MND as well (Jones, & Davis, 2004). 

In the case of MND, the inventory tracking and prevention of loss of goods are 
also important since the MND has been under pressure due to government budget cuts 
over the past decades. Per Reform of Defense 2020, the MND is re-structuring toward 
technology intensive forces, which means that they have to focus on the efficient 
management of limited resources. Accordingly, the MND sought to improve productivity 
using high technology, e.g., RFID, and thereby reduce costs. For example, the MND 
implemented RFID technology in a variety of fields such as the Ammunition Storage 
Warehouse (ASW) and Air Force Supply Depot. 

RFID is a revolutionary technology for improving the ability to track supplies, 
which will reduce cost and decrease loss of goods. However, it is imprudent to adopt the 
technology blindly, without considering all factors such as revenue and cost. Normally, 
new technology that will be able to improve the efficiency of the process is costly and 
demands a high budget. Accordingly, when it comes to planning implementation of the 
new system, it is tremendously important to assess the new technology’s ROI so as not to 
waste money. For the MND, which has been under pressure from the government to 
slash its budget, it is important to estimate the scalable ROI to demonstrate prudent 


spending. 


Private sector businesses have estimated the ROI at the corporate level. However, 
the problem is that they tend to assess the ROI by only considering cost and they do not 
take the revenue into account in assessing the ROI!. The MND convened a Performance 
Evaluation Conference (PEC) in 2005 to measure the performance improvement of IT 
based on the survey results. As will be explained in greater detail below, Jung (2007) 
used a BSC approach to assess respondents’ perception of the process improvement 
followed by the implementation of RFID in the ASW. The authors will contend that his 
approach does not capture ROI (K. S. Lee, 2004). 

In this project, the authors intend to suggest the KVA theory as a tool to quantify 
the ROI by doing proofs of concept on two cases: ASW and Air Force 40" Supply Depot. 
Hopefully, this project will provide decision-makers in the MND with a notional hurdle 
rate 2 to make decisions on whether they should proceed with RFID investments (C. S. 
Park, 2007) 

Typically, a hurdle rate is based on a conservative rate of return such as the risk- 
free rate compared to the internal rate of return of a given project. In this study, the 
authors are using a notional expectation that the ROI of projects where RFID was 
implemented. This represents a departure from the normal definition of hurdle rate but is 
used here to set expectations for ROI on RFID projects at a higher level. This provides a 
more aggressive expectation for the performance of this technology in new projects. 

The methodology used in the present study, i.e., knowledge value added, allows 
the generation of value-based comparables for the purposes of establishing an objective 
return on investment measure that is not based solely on cost; rather, it is based on an 
objective and defensible metric of revenue or benefit that is comparable to and can be 
calibrated with the market. Coupled with risk analysis, this method can be used to 
measure the return on investment for a certain project and therefore, using such an 
approach, the authors can replicate the methodology for multiple projects to generate a 


portfolio of projects. Similar to the Capital Asset Pricing Model (CAPM) or Arbitrage 





1 ROI= (Revenue-Cost)/Cost. 


2 In business and engineering, the minimum acceptable rate of return, often abbreviated MARR, or 
hurdle rate is the minimum rate of return on a project a manager or company is willing to accept before 
starting a project, given its risk and the opportunity cost of forgoing other projects (C. S. Park, 2007). 
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Pricing Theory (APT) methods, this portfolio serves as a proxy for the market, and based 
on the levels of risk involved in each individual project, the authors can similarly 
determine a relevant hurdle rate and required rate of return threshold. 

Discount rate, hurdle rate, and required rate of return are all related concepts used 
in investment decision making pertaining to return on investment of a certain project. A 
discount rate is typically applied in a discounted cash flow model to take into account 
varying risk levels of different projects and discount them at the appropriate risk-adjusted 
rate of return (high risk projects require high returns to compensate for the added risk), in 
order to arrive at a net present value. A required rate of return is similar to a discount rate 
in that it is used as a hurdle rate, above which a return on investment justifies investment 
in a particular project. A discount rate is determined several ways, from a typical Capital 
Asset Pricing Model (risk-free rate plus an added excess return commensurate with the 
market premium calibrated to the excess risk involved in the investment) to a Weighted 
Average Cost of Capital approach (where the total cost of equity, debt and preferred 
equity are added to determine the actual flotation cost of invested funds) and Multiple 
Asset Portfolio Theory approach (looking at multiple risk factors and risk premium in the 
market), whereas the hurdle rate can be determined using any combination of these 
methods as well as a subjective required return based on investors’ or decision- 
makers’ risk preferences, and calibrated with existing or comparable projects (J. Mun, 


2006). 


C. RESEARCH OBJECTIVES 


Even though the MND has tried to adopt high technology and information 
technology to improve logistics, there is no objective methodology to measure the ROI 
from mandating new systems and programs. For this reason, the authors want to 
introduce the KVA theory to the MND as a way to estimate the ROI on potential 


investments in new technologies. 


The goal of this research is threefold. First, the authors will introduce the KVA 
theory as a framework to estimate the knowledge embedded in Information Technology 


(IT) in order to assess the Return On Knowledge (ROK) and ROI of this technology. The 
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KVA methodology, which has not been introduced and used in the RoK, is a simple and 
inexpensive performance measurement to estimate the ROI of IT. Second, the authors 
will provide a potential hurdle rate that can be used as a reference in deciding whether to 
adopt a new technology such as RFID system. Third, the authors will compare the ROI 
of other RFID case studies based on projected data. However, this project used the real 
data of implemented RFID systems in the MND and analyzed the data with the KVA 
methodology. 


The third objective will be done by analyzing the potential benefits of the 
implementation of RFID in the ASW and Air Force Supply Depot by using a KVA 
methodology. The KVA results through these two proofs of concept can be used to set a 
hurdle rate, which can be applied to similar MND technology acquisitions; thus, it 
provides decision makers with a disciplined approach to reach and with budget decisions 


that can provide better ROIs to the MND. 


D. METHODOLOGY 


This project will assess the efficiency of RFID technology in military logistics, in 
terms of process capacity and productivity. This analysis will help evaluate the impact of 
this IT technology on process improvement and productivity. The authors will model the 
standard processes and related sub-processes of the inventory warehouse using RFID 
technology in ASW and Air Force Supply Depot. The KVA methodology will be used to 
give a hurdle rate in the form of ROI and measure the impact of improved processes and 
technologies on the current process. For analyzing the sub-process of this model, time- 
to-learn, number of personnel involved and the number of times each process is 
performed were utilized. The financial and human resource data used in this model will 
include actual Fiscal Year 2006 and 2007 data collected from the MND, the Army 


logistics department and Air Force headquarter of RoK. 
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I. LITERATURE REVIEW 


A. PERTINENT LAWS 
1. Military Reform Plan 2020 


Military reform plans were announced in 2005 in order to suggest what strategic 
vision the MND should be seeking to achieve. For a long time, the innovation of more 
advanced military reform was continually required due to the declining budgets. The 
MND seeks an 11.1% increase in military spending per year over the next 10 years, as 
part of efforts to build more future-oriented forces (I. C. Lim, 2008). This plan focuses on 
developing the country’s labor-intensive force into a smaller but stronger one that is 
suitable for the next generation of warfare. RFID technology is one of the methods to 


achieve the MND’s goal. 


However, the big problem is funding for new technology. In recent years, annual 
defense budget increase rates have been between 6.3% and 9.9%. Under the plan of an 
11.1% increase on a yearly basis, the country will spend a total of 289 trillion won ($281 
billion) on its military over the next 10 years. The defense budget is approximately 2.5% 
of the Gross Domestic Product (GDP). Put simply, a high-tech military force demands a 
high initial budget. Accordingly, the MND should verify its prudent management of 
budget by implementing efficient cost-benefit analyses. Figure 1 shows the change of 


defense budget versus GDP (J. O. Baek, 2007, p. 45). 
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Figure 1. National Defense Budget of RoK (From: J. O. Baek, 2007, p. 49) 


Also, most technologies required for an advanced military force are now highly 
related to knowledge-based technology such as RFID and the defense information web 
system, etc. As the military weapon systems and military infrastructure move from the 
industrial era to the knowledge information era, the current accounting systems used to 
quantify value and cost become less and less applicable to the military environment. 
There has been no appropriate tool to measure the benefit of the implementation of new 
IT so far. If the value of knowledge embedded in IT can be measured, then the benefits 


of the implementation of the IT can be evaluated. 


The KVA is a methodology designed to estimate the knowledge value resident 
throughout core processes including supporting IT. This is the KVA’s main strength 
compared to the other methodologies such as BSC. One benefit of the KVA in this 
project is that the authors will be able to identify bottlenecks in the process. Then, it can 


determine which processes to reengineer using new technology such as RFID. 


B. CURRENT IMPLEMENTATION OF RFID IN THE MND 


1 How to Apply RFID Technology to Support Military Defense 
Logistics 

Since 2004, the MND and the Ministry of Information and Communication (MIC) 
have collaborated on plans for the construction of U-defense? in order to realize the 
Military Reform 2020 goals. This is a blueprint to apply RFID technology to the public 
fields such as military logistics. Radio Frequency - Ammunition Information System 
(RF-AIS) and F-15K parts management through RFID are two of these projects. In 
particular, the RoK army formed in 2006 a taskforce charged with broadening RFID 
implementation in the defense field beyond its ammunition inventory system. On top of 
that, they were seeking to form a roadmap to make full use of RFID technology with a 
variety of ways to improve their military logistics. The MND is trying to apply various 
ideas and private sector managerial approaches and technologies that can be adapted to 


the unique military environment. 


a. RF-AIS 


The MND operated an AIS to control the whole process of ammunition 
distribution before using RF — AIS. To be specific, distribution is now automatically 
processed from the requirement to supply just-in-time by attaching RFID tags to the 
pallets, boxes and various kinds of ammunitions. This system made it possible to supply 
the required ammunition to the users as soon as possible, which is an appropriate system 
to respond to the current operational speed on the battlefield. In addition, this system 
decreased the job redundancy of ammunition management and saved substantial 


administrative time (J. H. Lee, 2005, p. 46). 


3 U-defense is the acronym of Ubiquitous defense. 
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Figure 2. Ammunition Supply Process 


The RFID reduced the distribution time, investigation time of ammunition 
volume, and decision time for release of ammunition. Furthermore, it became possible to 
manage special ammunition such as grenades by checking the volume in real time. 
Above all, it was possible to track the ammunition from production to consumption 
through RFID tags. In other words, the ammunition flow can be tracked in real time and 
the records of ammunition can be analyzed since the current state of distribution of 
ammunition is constantly updated in the ammunition headquarters. The MND is trying to 


attach the RFID tags to all kinds of ammunition bullets and boxes. 


b. F-15K Parts Management System 


The benefits through RFID used to manage F-15K repair and spare parts 
are almost the same as the above ammunition management system in the MND. To be 
precise, RFID technology removed the need to physically confirm transfer at the port of 
the containers filled with repair and spare parts for F-15K, along with their movement 
from point ‘A’ to point “B.’ Other benefits through RFID include: (1) automation through 


‘RFID reader’ on acceptance, handover, and warehousing of containers; (2) convenient 
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inventory; and (3) decreases in administrative tasks. Furthermore, quantitative benefits 
are: (1) reduction in administrative time and manpower required to manage inventory; (2) 
decrease in waiting time for maintenance; and (3) prevention of errors by manual input 
(Report of Korea Institute of Defense Analysis (KIDA) IT Consulting Group to the MND, 
2005). 


C. PRIOR RESEARCHS 


There were three RFID related projects performed at NPS. These studies 
projected the potential benefits of using the technology in three different logistics 
processes, two of which were comparable to the two case studies reported in the current 
study. The authors will briefly review each of the prior studies in what follows. Then the 
authors will review the use of the BSC approach as a way to estimate the benefits of 


using RFID technology in the ASW case at the MND. 


iF A Hybrid Approach to the Valuation of RFID/MEMS Technology 
Applied to Ordnance Inventory (Doerr, Gates, & Mutty, 2005) 

This report analyzed the costs and _ benefits of fielding 
RFID/MicroElectroMechanical System (MEMS) technology for the management of 
ordnance inventory. The approach was named hybrid because both qualitative and 
quantitative methods were used to investigate the cost-benefit of a potential RFID/MEMS 
implementation. 

The ROI calculation we report is based on the standard formula for the 

Internal Rate of Return, with changes in expected expenditures, or cash 

flows, taking the place of revenue — cost. That is, the return on investment 


will be calculated as the discount rate that makes the net present value 
(NPV) of cash flow changes equal to zero. (Doerr et al., 2006, p. 8). 


IRR =i > NPV = > AE{cashflows|/i =0 


The result of this study using hybrid approach found that: 


Our cost analysis showed that this RFID/MEMS application should 
produce substantial cost savings, and our sensitivity analysis suggested 
that these savings were robust against moderate mis-estimates from our 
subject matter experts (Doerr et al., 2006, p. 33). 
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Even though the hybrid approach showed the apparent strength of the cost-based 
analysis in this case, the authors agree with the following statement: “it remains 
important with RFID to be able to systematically weigh non-cost benefits, and 


implementation obstacles” (Doerr et al., 2006, p. 34) 


In this sense, the KVA approach can provide a systematic means to produce an 
estimate of non-cost benefits using common units of outputs (Stewart. T.A., 1997, p. 239) 
as a surrogate for revenue when used in conjunction with the market comparables 
approach. The authors will apply the KVA methodology to estimate the ROI on two 
actual implementations of RFID in the MND. 


2. The Concurrent Implementation of Radio Frequency Identification 
and Unique Item Identification at Naval Surface Warfare Center, 
Crane, IN as a Model for a Navy Supply Chain Application (Obellos, 
Colleran, & Lookabill, 2007) 


The purpose of this project was to identify the typical Navy Supply material 
operational processes as seen at Naval Surface Warfare Center Crane, IN (NSWC Crane). 
The study used this information as a basis for identifying the most promising automated 
information technology for those operational processes. The study also provided an 
outline for an RFID/UID concurrent implementation plan that best applies to NSWC 
Crane. It concluded with a Knowledge Value Added (KVA) Return on Investment (ROI) 
analysis of the RFID/UID implementation plan. 


The study concluded that RFID/UID technology implementation would 
increase the ROI benefit for the inventory management process analyzed by investing in 
RFID/UID technology. However, unlike the current study, their ROI estimates were 
based on projected benefits and were not based on actual implementation of the 
technology in the process. The expected ROIs on the use of RFID/UID for the inventory 
management process appeared to be somewhat conservative based on a comparison to 


ROIs from the implementation of the technology in the current study. 
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3. A Comparable Market Study of RFID for Manual Item-Level 
Accountability Inventory and Tracking Systems (V. V. Courtney, 
2007) 


This thesis focused on estimating the ROI for use of RFID technology in item- 
level tagging of assets. The business model used for this thesis focused on organizations 
that provide reference material management services (RMMS), e.g., library reference 
material, employee privacy information records, laptops, etc., to the DoD users. The 
thesis evaluated the capabilities available in RFID technology that could eliminate the 
challenges posed by the lack of item visibility that existed in manual RMMS business 


processes. 


This thesis reviewed the experience of companies in the private sector that have 
reported positive ROIs benefits by implementing RFID for the purpose of asset 
control/management. The study also projected the potential ROIs from using this 
technology in the DoD logistic processes. However, it also pointed to potential 
roadblocks in implementing the technology. “The major obstacle facing an organization 
desiring to integrate RFID capabilities lies in the initial investment of primary cost 
drivers such as price per tag and software’(V. V. Courtney, 2007, p. 73). The current 
research also found that in actual implementations the ROI on use of this technology was 


sensitive to these costs. 


4. Balanced Scorecard (BSC) 


At the level of the individual organization, the BSC has been used to measure its 
own performance. The followings is the basic concept of BSC: 

The BSC measures performance from at least four perspectives: learning 

and growth, internal process, customers, and financial. Adequate 

investment in these areas is assumed to be critical for long-term success. 

Together, these four perspectives attempt to provide a balanced view of 

the present and future performance of the business (Housel and Bell, 2001, 

p. 38). 

The BSC is the most typical measurement tool in the context of stakeholder 
theory. BSCs focus on developing and monitoring strategy via a family of measures. 


They help translate corporate strategy into a set of goals and objectives, and their success 
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is tracked through multiple performance measurements. As such, BSC aids in 


communication and in setting strategic objectives (Jensen, 2001). 


BSC has been used in the MND to analyze the cost-benefit of RFID. In 2007, the 
Korea Aerospace University (KAU) suggested the benefit of RFID by using Core- 
Elective Performance evaluation. Considering the fact that the military is a non-profit 
organization, the KAU set the core performance index to make up for the traditional 
performance evaluation’s limitations. This new approach classifies the core performance 
index into four perspectives according to their functional standpoints: i) financial point, 
11) system satisfaction point, 11) job-processing point, and iv) renovation and growth 


point. The specific lists are as follows (K. Y. Jung, 2007): 


Table 1. Core performance index (From: K. Y. Jung, 2007, p. 33) 

















Standpoint Core performance index 
Renovation | Reducing mixed-loading ammo System application rate 
Growth ; ; . 
Reducing non-approved bullet Requirement reflection 
loading 
Job- Reducing processing error Reducing inventory check error 
Erecessiie Increasing storage space utilization | Checking the storage just in time 
Financial Reducing distribution time Reducing daily-checking time 
Reducing administrative tasks Reducing inventory-checking 
time 
Customer Sharing information in real time Utilization convenience 
saeracion 3D simulation satisfaction Education performance 
satisfaction 
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The main purpose of the research was to explore the performance 

measurement of public project and to show the different degrees of 

satisfaction on the performance of projects by positions and roles of 

interviewee, e.g., project managers, project programmers, administrator of 

organization, and user in their project (K. Y. Jung, 2007, p. 79). 

Jung (2007) used a BSC approach to assess surveyees’ perception of the 
improvement resulting from the implementation of RFID in various logistics processes. 


He found that a significant number of the surveyees believed that the use of RFID 


technology improved the ammunition distribution process. 


In detail, the researcher collected forty copies out of fifty-three surveys from the 
respondents; of these forty copies, thirty-eight surveys all but two surveys that were not 
properly answered were analyzed by the Statistical Package for the Social Sciences 
(SPSS) 12.0 program. He used ‘Cronbach Alpha Value’ and ‘Factor Analysis’ to verify 


the validity and reliability of survey results. 


Even though the BSC used by the KAU was modified to be applied to the military 
environment, this approach still had limitations similar to those of the traditional BSC. 
“The actual nature of the relationship among the indicators is more a matter of what the 
individual manager believes, or via a consensus-gaining process, what a group of 


managers believes about the relationship among the measures” (Housel & Bell, 2001). 


The BSC does not yield a score that would allow us to distinguish winners 
from losers. For this reason, the system is best described not as a scorecard, 
but as a dashboard or instrument panel. It can tell managers many 
interesting things about their business, but it does not give us a score for 
the organization’s performance (Jensen, 2001, p. 19) 


In practice, scorecards typically have about five subscales for each 
perspective. The scales use ratio, interval, ordinal and nominal approaches 
to capture data about corporate performance. Resulting scores are 
normalized to combine them into a single decision point. This approach 
assumes that the various measures are related to one another in a cause- 
effect chain linked to corporate strategy and the corporate bottom line. 
Developing a mathematical algorithm for the various measures within a 
consistent theoretical framework has proven to be difficult (Housel and 
Bell, 2001, p. 38). 
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Table 2 shows ‘Balanced Scorecard Perspectives’ as mentioned in the previous 


paragraph. 


Table 2. Balanced Scorecard Perspectives (From: Housel and Bell, 2001, p. 38) 














Perspective Focus 


The Learning and Growth Perspective Directs attention to the organization’s 


people and infrastructure. 


The Internal Perspective Focuses attention on the performance of 
the key internal processes that drive the 
business. Improvement in internal 
processes now Is a key lead indicator of 


financial success in the future. 


The Customer Perspective Considers the business through the eyes of 
a customer, so that the organization retains 
a careful focus on customer needs and 


satisfaction. 


The Financial Perspective Measures the ultimate results that the 


business provides to its shareholders. 





As previously mentioned, BSC is a managerial tool of stakeholder theory. In 
stakeholder theory, the notion of a “balanced” scorecard is appealing, but suffers from 
many flaws. Using multiple survey questions in the BSC to evaluate the performance of a 
new system or process unit may allow managers’ biases to affect the outcomes, and also 
do not give a relatively objective score for the organization’s performance, or for the 


performance of its business units. 


Survey results are widely used to assess performance in the management literature, 
and self-assessments of performance are commonly accepted surrogates for performance. 


Also, there are commonly used methods available to assess and correct the sort of bias to 
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which the authors refer. However, the authors believe the KVA approach, detailed below, 
is superior because some of the data are market provided. Also an analysis of the data 
(stakeholder-provided and market-provided) can be accomplished by disinterested 
investigators such as the authors of this thesis (of course, if the analysis were undertaken 
by consultants or as a part of a funded research project, the same limitations of bias 


would apply to the KVA approach). 


Finally, when the authors claim the KVA approach is superior, they mean it is 
superior in terms of outcome, e.g., it will yield better decisions in terms of which 
technologies (like RFID) to acquire, and which technologies should be bypassed (at least 
temporarily) or abandoned. In this literature review, the authors have pointed to a 
number of authors who have used KVA, and who argue for its superiority on the grounds 
the authors have detailed. But this claim of superiority is an empirical one, and it remains 
an issue of open debate in the literature. The direct support of this claim of superiority is 
beyond the scope of this thesis, which will not itself compare approaches, but instead, use 


the KVA approach as an alternative to the BSC approach already used. 


Thus, since BSC lacks a common theoretical framework and unit of analysis, this 
approach is not an adequate measurement tool to assess IT performance, specifically the 


knowledge value embedded in assets such as IT systems and humans. 
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Hl. KVA THEORY 


A. INTRODUCTION 


It is difficult to find a metric that can objectively and accurately measure 
performance. One common measure that is frequently used is cost and its many 
variations, but this does not define a value in a non-profit organization such as the MND 
and the DoD. Another metric is ROI, although it is not easy to assess the ROI on 
organization assets such as humans and IT systems, due to the difficulty of allocating and 
quantifying the revenue attributable to those assets. However, KVA provides a 
framework to estimate the ROI by allocating revenue in common units of output to each 


process (Housel and Bell, 2001; Seaman, Housel, & Mun, 2008, p. 14). 


This project utilizes two previous studies for purposes of comparison. The first is 
‘The Concurrent Implementation of Radio Frequency Identification and Unique Item 
Identification at Naval Surface Warfare Center, Crane, IN as a Model for a Navy Supply 
Chain Application’ (Obellos, Colleran and Lookabill, 2007). The second is ‘Integrated 
Portfolio Analysis: Return on Investment and Real Options Analysis of Intelligence 
Information Systems (Cryptologic Carry On Program)’ (Rios, Jr., Housel, and Mun, 
2006). The authors referred to the latter report for most of the review of the KVA theory 
and its application to estimating the ROI on IT. The other project applied the KVA 
methodology to derive the ROI on IT investments by quantifying the value of RFID/UID 
technology, specifically the efficiency (productivity) and effectiveness (profitability) 
created by RFID/UID in the inventory process, which made it directly applicable to this 
study. 


B. RETURN ON INVESTMENT 


Large cost increases and extended delivery schedules in the DoD programs 
caused inaccuracies of 20-50% or higher in estimates of time and money. Consequently, 
it has been difficult for decades to derive the accurate ROI on the DoD IT development 


programs. Likewise, large technology projects in the private sector have shown a low 
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success rate (as shown in Figure 3). The research firm The Standish Group has shown 
that the chance of failure rate was 68% in the case of IT projects with investment over $3 


million (Rios, Housel, & Mun, 2006, p. 3). 


Project 
Success 7/% 
Rate 


$3.00-$6.00M > $10.00M 
S-$3.00 M $6.00-$10.00M 
Size of Project ($) 
Source: The Standish Group CHADS Survey, 2004. 


(Source: The Standish Group, CHAOS Survey, Boston, 2004.) 





Figure 3. Rate of Successful IT Project Delivery (From: Rios et al., 2006, p. 3) 


This high failure rate has forced the private sector to develop accurate metrics to 
assess the value of IT investments. The corporate-level approaches deal with the value 
from human and IT systems to the overall performance; the sub-corporate-level 
approaches try to measure productivity (output-input ratios) on their core processes. The 
private sector has tried to use traditional financial measures and heuristic methods. The 
common goal of these methodologies is to provide managers with the value added by IT 
investments. Table 3 shows the types of metrics used to estimate the value of IT 


investments (Rios et al., 2006, p. 3). 
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Table 3. 


Approaches to Measuring Return on IT (From: Pavlou et al., 2005, p. 203) 


Level of Analysis] Approach 
———— or] ee ee 


=a 
Process of 
Elimination 
(Le. 
Knowledge 
Capital) 


Production 
Theory 


Aggregate 
Corporate (firm) 


Resource- 
sed View 


Option 
Pricing Model 


Corporate/ sub- 
corporate 


Family of 
Measures 

(Le. Balanced 
Scorecard) 


Cost-Based 
(Le. Activity- 
Based 
Costing) 


Sub-corporate 
(Process) level 


Knowledge 
Value Added 
(ie. EVA) 


eTreats effect of IT on 
ROJ as a residual after 
accounting for other 
capital investments 


«Determines IT effects 
through input output 
analysis using regression 
modeling techmiques 

«Economic production 
function links IT 
investment input to 
productivity output 


Links firm's core 
capabilities with 
competitiveness 

*Uniqueness of IT 
Tesource = competitive 
advantage 


*Detennines best point to 
exercise an option to 
invest in IT 

eTiming exercise option = 
value 


«Measures multiple 
indicators to derive 
unique contributions of 
IT 


«Uses cost to detemmine 
value of IT 

«Derivations of cost = 
value 


eAllocates revenue to IT 
proportionate to 
contributions to process 
outputs 

eIT contributions to 
output = IT value-added 


«Uses commonly 
accepted financial 
analysis techniques and 
existing accounting 
data 


«Uses econometric 
analysis on large data 
sets to show 
contnbutions of IT 


e Uses strategic 
advantage approach to 
IT impacts 


ePredicts future value of 
IT investment 


«Captures complexity of 
corporate performance 


« Captures accurate cost 
of IT 


e Allocates revenue and 
cost of IT allowing 
ratio analysis of IT 
value-added 


eCannot dnil down to 
effects of specific IT 
initiatives 

eROI on IT difficult to 
measure directly 


e”Black-box" approach 
with no intermediate 
mapping of IT's 
contibutions to outputs 


e Causal mapping 
between IT investment 
and firm competitive 
advantage difficult to 
establish 


eNo surrogate for 
revenue at sub- 
corporate level 


eNo common unit of 
analysis’ theoretical 
framework 

¢ Multiple indicators 
required to measure 
performance 


eNo swrogate for 
revenue at this level: 
no ratio analysis 


eNot directly applicable 
to highly creative 
processes 





Most ROI metrics focus on corporate-level financial returns, which cannot be 
applied to estimate the value of IT investments of the MND and the DoD. From the 
perspective of the military, the overall operational readiness cannot be measured in terms 
of revenue. Instead, this project will use the KVA theory as an alternative to identify and 


quantify the value by implementing the RFID system (Obellos et al., 2007, p. 79). 
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The KVA theory has been used in many areas in the private and public sectors. 
For example, Courthouse Athletic Club was saved from bankruptcy and secured market 
share by virtue of a KVA analysis (Housel & Bell, 2001, p. 106). For the past several 
years, research on measuring the ROI on IT systems using the KVA methodology has 
been performed at the Naval Postgraduate School (NPS). Hence, it would be beneficial 
to introduce and explain the concept and steps to apply the KVA to other organizations 


such as the MND, which has not yet used it. 


Cc: KVA THEORY OVERVIEW 


Housel and Bell (2001, p. 110) defined knowledge as “something that enables a 
person or machine to solve problems of a certain type” For instance, “a set of logical 
rules or a computer program that can be used to solve the problem is knowledge’; in the 
case of people, they can have knowledge, but they are a knowledge source rather than 
knowledge itself. 

The Knowledge Value Added (KVA) methodology was created by Dr. 

Thomas Housel and Valery Kanevsky and has been published 

internationally in numerous articles and books about knowledge 


management and business process reengineering (Housel & Kanevsky, 
1994; Kanevesky & Housel, 1997) 


The KVA theory provides a metric to objectively estimate value and allocate 
revenue to all organizational assets including tangible resources, e.g., material, supplies 
and equipment, and intangible resources, e.g., human capital, IT system, and 


organizational process (Pringle & VanOrden, 2009, p. 7). 


1. Fundamental Assumptions of KVA 


The KVA assumes that if an organization has the knowledge necessary to make a 
change in a process, then it can produce a change by virtue of the knowledge. The 
underlying assumptions are shown in Figure 4. “By definition, if we have not captured 
the knowledge required to make the changes necessary, we will not be able to produce 


the output as determined by the process” (Housel & Bell, 2001, p. 94). 
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Fundamental Assumptions of KVA 


Underlying Model: Change, Knowledge and Value are Proportionate 


Input Process Output 
Xx : Y 


PAT =¥ 


Fundamental Assumptions: 
1. If X=Y, no value has been added. 
2. “Value” is proportional to change. 


3. “Change” can be measured by the amount of 
knowledge required to make the change. 


So “value” is proportional to “change” is 
proportional to “amount of knowledge required 
to make the change. 





Figure 4. Fundamental Assumption of KVA (From: IS 4220-Business Process 
Reengineering with IT) 


2. KVA Methodology 


According to the KVA theory, there are several different approaches to measure 
the value of knowledge resident in the core processes; the knowledge within a process 
can be embodied as learning time, process instructions, decision points, line of code, 
information theory ‘(bits)’ and entries on a sales order form. Table 4 shows three 


approaches to the KVA (Housel & Bell, 2001, p. 95). 
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Table 4. 


Three Approaches to KVA 











Steps 
1 


2 


Learning time 


Process description 


Identify core process and its sub-processes. 


Establish common units to | Describe the products in 


measure learning time. 


Calculate learning time to 


execute each sub-process. 


terms of the instructions 
required to reproduce 
them and select unit of 


process description. 


Calculate number of 
process instructions 
pertaining to each sub- 


process. 





Binary query method 


Create a set of binary 
yes/no questions such 
that all possible outputs 
are represented as a 
sequence of yes/no 


answers. 


Calculate length of 
sequence of yes/no 
answers for each sub- 


process. 


Designate sampling time period long enough to capture a representative sample of 


the core process’s final product/service output. 


Multiply the learning time 
for each sub-process by 
the number of times the 
sub-process executes 


during sample period. 


Multiply the number of 


process instructions used 


to describe each sub- 


process by the number of 


times the sub-process 


executes during sample 





period. 


Multiply the length of 
the yes/no string for each 
sub-process by the 
number of times this 
sub-process executes 


during sample period. 


Allocate revenue to sub-processes in proportion to the quantities generated by 


step 5 and calculate costs for each sub-process. 


Calculate ROK, and interpret the results. 
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This study will choose learning time as a representation of knowledge. In this 


case, learning time can be defined as the amount of time to study the know-how 


necessary to make process outputs. Learning time provides a quick and convenient way 


to estimate the amount of knowledge in a certain process (Housel, 2009). 


The process required to implement the KVA methodology is summarized in Table 


5 (Rios, Housel, & Mun, 2006, p. 8). 


Table 5. NPS valuation Framework 














Data Collection 


e Collect baseline data 

e Identify sub-process 

e Research market comparable data 
e Conduct market analysis 


e Determine key metrics 


KVA Methodology 





Step 1: Calculate time to learn. 


Step 2: Calculate value of Output (K) for each 
sub-process 


Step 3: Calculate Total K for process 


Step 4: Derive Proxy Revenue Stream (when 
desired) 


Step 5: Develop the Value Equation Numerator 
by assigning revenue streams to sub-processes 


Step 6: Develop value equation denominator by 
assigning cost to sub-process 


Step 7, 8, 9: Calculate metrics: 

Return on Investment (ROT) 

Return on Knowledge Assets (ROKA) 
Return on Knowledge Investments (ROK]) 








The first step is to collect the data on identified processes and sub-processes 


necessary to produce an output. Comparing cost and revenue data through market 


research with other organization with similar processes extends this step to establish 


baseline information. Then, the estimation on value and cost can be performed by the 


KVA methodology. The final step is to analyze the ROI using the data from cost-per-unit 


and price-per-unit estimates (Rios et al., 2006, p. 8). 
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By finding the value of knowledge resident in an organization’s core process, 
employees and IT, the KVA identifies the actual cost and revenue of a process output. 
According to Rios, Housel and Mun (2006, p. 8), the KVA can calculate unit costs and 
unit prices of products and services since it identifies every process necessary to make an 
output and the historical costs and revenues; an output can be a product or service as the 


end result of an organization’s operations, as shown in Figure 5 (Rios et al., 2006, p. 8). 


Human Capital Assets a a i 


* Labor, Training, Skills, Knowledge 
PROCESS 1 


* Sales 





Human Capital Assets 


* Labor, Training, Skills, Knowledge PROCESS 2 
* Manufacturing + Product 


+ 
* Target Tracking 
Information Technology Assets 


Human Capital Assets 
Labor, Training, Skills, Knowledge 


 —" PROCESS 3 
* Billing 


Information Technology Assets * Firing Weapons 


+ Service 





Figure 5. Measuring Output 


As a performance measurement tool, the methodology has been used by the DoD 


and can be used by the MND, as well (Rios et al., 2006, p. 10): 
e Compare all processes in terms of relative productivity 
e Allocate revenues to common units of output 
e Measure value added by IT by the outputs it produces 
e Relate outputs to cost of producing those outputs in common units 


e Provide common unit measures for organizational productivity 
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Furthermore, based on the tenets of complexity theory, the KVA assumes that 
humans and technology in organizations add value by taking inputs and changing them 
(measured in units of change or complexity) into outputs through core processes. The 
amount of change an asset produces within a process can be a measure of value or 


benefit. Additional assumptions are as follows (Rios et al., 2006, p. 10): 


e Describing all process outputs in common units (e.g., the time it takes to 
learn to produce the required outputs) allows historical revenue and cost 


data to be assigned to those processes at any given point in time. 


e All outputs can be described in terms of the time required to learn how to 


produce them. 


e Learning Time, a surrogate for the knowledge required to produce process 
outputs, is measured in common units of time. Consequently, Units of 


Learning Time = Common Units of Output (K). 


e Common units of output make it possible to compare all outputs in terms 
of cost-per-unit as well as price-per-unit, because revenue can now be 


assigned at the sub-organizational level. 


e Once cost and revenue streams have been assigned to sub-organizational 
outputs, normal accounting and financial performance and profitability 


metrics can be applied. 


Non-profit organizations such as the DoD and the MND can generate market 
comparable data by describing processes in common units and comparing these to the 
common units of output in profit making companies. “Market comparable data from the 
commercial sector can be used to estimate price per common unit, allowing for revenue 
estimates of process outputs for non-profits. This also provides a common-units basis to 
define benefit streams regardless of process analyzed” (Rios et al., 2006, p. 10). The 
KVA is different from the other ROI models since it allows for revenue estimates 
enabling use of traditional accounting, financial performance and profitability measures. 
Table 6 provides comparison between traditional accounting and the KVA process 


costing; the former shows what was spent per category and the latter shows how it was 
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spent per process (Rios et al., 2006, p. 11). Figure 6 “provides a comparison of 


traditional corporate level revenue information while the KVA provides this kind of 


information at the sub-corporate level by taking the corporate level revenue and 


allocating it to sub-corporate process outputs” (Rios et al., 2006, p. 12). 


Table 6. | Comparison of Traditional Accounting versus Process Based Costing 


Traditional Accounting KVA Process Costing 


Compensation 


Benefits/OT 
Supplies/Materials 
Rent/Leases 
Depreciation 
Admin. And Other 
Total 


Explains what was spent 


$5,000 
1,000 
2,000 
1,000 
1,500 
900 
$11,400 





Traditional Accounting/ 


Finance Measure 


Sales/Revenues 


Product price 


Total Revenues 


Review Task $1,000 
Determine Op 1,000 
Input Search Function 2,500 
Search/Collection 1,000 
Target Data Acq 1,000 
Target Data Processing 2,000 
Format Report 600 
Quality Control Report 700 


Transmit Report 1,600 
Total $11,400 


juads spm j1 moy summjdxy 


KVA Process Value Measure 


Common units of output 


Market comparables: Price-per-unit of output 


Total units of output X price-per-unit = total 
revenue surrogate 





Figure 6. Comparison of Outputs Traditional Accounting Benefits (Revenues) versus 
Processes Based Value 


Processes in the KVA can be ranked depending on the degree to which they add 


value to the organization or its processes. It enables decision makers to identify which 


processes add value—those that will most likely contribute to accomplishing the mission, 


delivering a service, or meeting customer demand. 
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IV. CASE STUDIES (PROOFS OF CONCEPT) 


As stated before, RFID was used to improve the ammunition distribution process 
approximately five years ago. In particular, RFID was implemented by the Army for 
ammunition management and by the Air Force for F-15K parts management. This paper 
tries to demonstrate how the KVA can be used to estimate the ROI on implemented RFID 
systems these two cases. From the KVA results, the authors verified the change in the 


ROI and the ROK before and after RFID implementation. 


Again, the ROK is an estimate of the value or benefit over cost ratio for each sub- 
process in the ammunition distribution process and F-15K parts management process. 
The ROK % shows which of these processes add the most and least value to the overall 
distribution process and inventory management system, so that changes can be made to 
improve the process. For the convenience of readers, the ROI can be calculated by 


subtracting 100% from the ROK. 


Ultimately, the ratio of values from analyzing the data through the KVA will 
provide a new source of productivity information to decision makers before making an IT 
acquisition. Implementing a KVA methodology will create a new process performance 
metric that can be collected on a routine basis. These performance metrics provide the 
kinds of system performance information they need to make technology investment 


decision. 


A. AMMUNITION STORAGE WAREHOUSE (ASW) & 40TH SUPPLY 


DEPOT 
1 Process Description and Modeling 
a. ASW 


Before implementing RFID, the MND had used the software program AIS 
to optimize the process of requirement and distribution of ammunition. This program 
saved a great amount of time as well as improving job efficiency. However, it also 
consumed considerable time in managing the warehouse and checking ammunition 


loaded on trucks each time. For these reasons, more employees and time were required 
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for the ammunition distribution process. With the RFID implementation, waiting time 
was reduced and redundant processes were eliminated. The eleven sub-processes of 


distribution of ammunition were diminished to nine sub-processes. 


The next eleven processes were used for describing the baseline 
ammunition distribution process. Figure 7 depicts the “Before RFID’ process. As stated 
before, paperwork for ammunition requirement and approval is done through AIS (J. H. 


Lee, 2005, p. 46 ). 


2. Receiving R.P. & 
Drawing up A.P. 


9. Signing to 10. Signing to 
confirm (Company confirm (Battalion 


[AP _[Feskmonhos [AR [Amvaineaae | 
IAP [Mentos [SAO [CommwrnanrtnieOtes | 





Figure 7. Ammunition Distribution Process (Before RFID) 


Figure 8 represents the distribution process after RFID. The process is 
reduced to nine processes due to RFID. The workers in the process share the information 
automatically through the tags attached on the boxes and bullets. The users do not have 
to do the redundant work such as ‘Signing to confirm (Company).’ The ‘Signing to 
confirm (Company)’ process is a redundant work, similar to the ‘Signing to confirm 
(Battalion)’ process. Normally, this administrative process requires much time to 


complete because of the waiting time. The authors verified the significant time saved 
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from the technology. In the private sector, this time saving can lead to increased profits; 


in the public organization, it can greatly improve mission accomplishment. 


1 .Sending R.P d ivi .P. 
of Ammo. — Drawing up A.P. 

4.Proceed 5.A.S. Arrival 6.Movement 
to ASP at C.A.O to A.S.W 


7 .Loading 8.Signing to 9.Return to 
ammo. > confirm (Battalion) = Post 


Figure 8. Ammunition Distribution Process After RFID (From: J. H. Lee, 2005. p. 46 ) 





Table 7 is a brief description of the generalized process for this model. 


The bold characters represent the eliminated processes before and after RFID. 


Table 7. | Sub-Process Description 





Sub — Process Name Sub-Process Description 
1. Sending Requirement Paper (R.P.) The combat units require Ammunition 
for Ammo Supply Post (ASP) to provide ammunition 


by sending R.P through AIS. The time for 
this job is assumed to be 30 minutes 
including the administrative time. However, 
this time can vary depending on the delay 
time consumed by the senior officers who 
are responsible for signing documents. 

2. Receiving R.P. & Drawing up A.P. ASP receives the R.P through AIS from the 
(Approving Paper) combat units which required ammunition. 
Next, the administrative soldier draws up the 
A.P. The A.P will be transmitted to the 
senior officer through AIS. This time 
depends on the waiting time by the senior 
officer. In this paper, this process time is 
assumed to be 30 minutes. 
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Sub — Process Name 


Sub-Process Description 





3. Transmitting the A.P through AIS 


After getting approval from the senior 
officer, the A.P is sent to the combat units 
that requested ammunition. 





4. Proceed to ASP 


The units that demanded ammunition 
proceed to ASP holding the A.P. Distance is 
assumed to be 3 or 5 miles between the 
combat unit and ASP. Movement speed is 
authorized as approximately 37 mile per 
hour. After passing through ASP gate, the 
watrant officer of the combat unit goes to the 
administrative office in the battalion to 
verify A.P and to learn which warehouse is 
available. The administrative soldier informs 
the warrant officer of the correct warehouse. 





5. Designating A.S.W 


If the warehouse is set, the warrant officer 
goes to the administrative office of the 
company in charge of the designated 
warehouse. This company designates the 
Ammunition Soldier (A.S) who helps with 
loading and checking the ammunition. This 
process will be removed after RFID 
implementation due to the information about 
warehouse provided by RFID technology. 





6. A.S. Arrival at Company 
administrative office 


The designated A.S. comes to the 
administrative office. 





7. Movement to A.S.W 


Truck for loading ammunition goes to the 
A.S.W with A.S. 





8. Loading ammo 


The warrant officer loads the ammunition 
with the other soldiers. The A.S checks the 
whole process and the items such as right 
amount of ammunition and appropriate types 
of ammunition. This process is done 
manually by the A.S in the “Before RFID” 
process. 





9. Signing to confirm (Company) 


The warrant officer goes to the company to 
get confirmation for ammunition loading and 
to sign the paper in the administrative office. 
This process is executed right before going 
to battalion. This job will be eliminated after 
RFID implementation due to real data share 
with battalion. 











10. Signing to confirm (Battalion) 





The warrant officer goes to the battalion to 
do exact same work in the company. 
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Sub — Process Name Sub-Process Description 











11. Return to Post The combat units loading the required 
ammunition return to post. 

















b. 40th Supply Depot 


The 40th Supply Depot was selected for the purpose of this study, which 
had the project name of ‘Trial infrastructure of F-15K (new weapon) parts management 
system using RFID.’ The project period covers six months and the Depot has entered a 
stable state after five years of using RFID technology. The processes of the management 
system consist of receiving, warehousing, taking goods from the warehouse, and 
transportation. The system in use is composed of the server operating database, control 
system managing and controlling RFID, portable reader, fixed reader and reader for 
container, wireless Access Point (AP), and tag producer. Figure 9 shows the overall RFID 


system structure. 
System Structure 


Control System 


ASIS 2000 


| Wireless AP) 





wl 


il 


‘Portable Reader ) Fixed Reader Reader for Container 








Figure 9. System structure (From: Report of KIDA IT Consulting Group) 


With the help of the system, the 40th Supply Depot can do the auto- 


recognition for the shipping of containers, estimating storage space, conducting inventory, 
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and acquiring resources management information. Figure 10 illustrates the hardware 


structure of the 40th Supply Depot to automate the processes. 














2 . Oe ee. 


H/W Structure(40% Supply 


Fixed Reader for Large Scale Items 


H/W Structure(40® Supply 





Fixed Reader for Med/Small Items Wireless AP 








Figure 10. Hardware Structure (From: Report of KIDA IT Consulting Group) 


The authors will limit the KVA analysis to the inventory checking process 
due to the difficulty of collecting necessary data pertaining to all processes that the 40th 
Supply Depot implements using RFID. Although this is a substantial limitation compared 
to our initial goal of analyzing the ROI for the entire implementation, it is necessary to 


limit the scope of the investigation because of the availability of the authors’ time in 
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working on this thesis and for the purpose of comparing to the same sub-process in the 
‘RFID/UID’ case study (Obellos et al., 2007). The authors will return to this limitation 
in the Conclusions, but here note that the limitation is in keeping with their primary goal 
of providing a proof-of-concept for the KVA approach. Before implementation of RFID, 
the Depot checked the inventory through ten processes. After implementation of RFID, 
the necessary processes were reduced to six. Figure 11 shows the processes to be 


modeled before implementing RFID in the Depot. 


1. Print inventory 2. Conduct 3. Record count 
worksheet. inventory of items. on worksheet. 


4. Manually input . Run exception 
worksheet data into compute report of missing items. 


6. Condu . Record count 8. Manually input 
recount, on worksheet. worksheet data into Compute 


9. Print final inventory 10. Print master 
discrepancy report. inventory listing. 





Figure 11. Inventory checking processes before RFID 
(From: Survey results from the 40th Supply Depot) 


With the help of RFID, three processes were merged into one process; the 
second, third, and fourth processes of ‘Before RFID’ were consolidated to become the 
second process of ‘After RFID’ and the sixth, seventh, and eighth processes of ‘Before 
RFID’ were integrated as the fourth process of “After RFID.’ Currently, the inventory 
checking process is performed through six processes. Figure 12 depicts the inventory 


checking processes of “After implementation of RFID.’ 
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1. Print invento 2. Conduct inventory with PDA & transfe 
worksheet. 


3. Run exception 4. Reonduct inventory with PDA & transfer 


report of missing items data wirelessly to computer. 


. Print final inventory 6. Print master 
discrepancy report. inventory listing. 





Figure 12. Inventory checking processes after RFID 
(From: Survey results from the 40th Supply Depot). 


In the case of the 40th Supply Depot, this consolidation resulted in labor 
savings of 38 soldiers and streamlined the inventory checking processes with the help of 
RFID. Figure 13 demonstrates how the employee conducts inventory with Personal 


Digital Assistants (PDA). 





Figure 13. Inventory with PDA 
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Ze Data and Assumptions 


The following data and assumptions will be applied to the ammunition 


distribution model and the inventory process of the 40" Supply Depot model. 


a. Data 
e Number of Employees 


The ‘Number of Employees’ column indicates the number of personnel 
involved in the specific sub-process. The number of personnel participating in each 
process is based on the normal process of ammunition distribution and inventory 


checking including enlisted men, sergeants and officers within the process. 
e Rank Order of Difficulty 


All the processes are ranked in order of difficulty to learn, where 1 = 
easiest and n = hardest. This order is ranked intuitively by the top manager according to 
the complexity of learning each process. The complexity of the processes is also 
indicated by the relative learning time column, where the most complex tasks are 


presumed to take longer to learn. 
e Relative Learning Time (RLT) 


The RLT is derived from the relative distribution of 100 available units of 
time (or days, weeks, etc.) or hours in this case for the average person to learn how to 
perform each of the processes, including learning to manually perform what is currently 


automated. 
e Actual Average Learning Time (ALT) 


The actual learning time (hours, days, weeks, etc.) is what it would take to 
train the beginner to perform each of the processes to the degree of a skilled person. This 


learning time is used for calculating the value of knowledge made in each process. 
° Correlation 


The accuracy of data given for ‘Rank Order of Difficulty,’ ‘Relative 


Learning Time,’ and ‘Actual Average Learning Time’ is verified by testing the 
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correlation among the three. If the correlation is equal or more than 0.85, the data is 
assumed to be reliable; especially, the correlation between ‘Relative Learning Time’ and 


‘Actual Average Learning Time’ is more important since these are more granular 























estimates. 
Table 8. Correlation in ASW and the 40th Supply Depot 
ASW 40th Supply Depot 
Correlation 
Before RFID After RFID Before RFID After RFID 

Rank Order of 84% 15% 82% 78% 
Difficulty vs. RLT 

RLT vs. ALT 96% 16% 88% 97% 




















e Percentage Automation 


This is a representation of the extent to which automation is utilized in the 
sub-process. Automation is measured on a scale from 0-100%. Also, the Percentage 
Automation column represents how IT is used to complete the process, hardware and 
software IT designed and implemented for the purpose of enabling distribution processes. 
The degree of automation in the sub-process is considered the amount of activity that is 


carried out completely by IT resources. 
e Times Performed in a Year 


The times performed in a year category represent the number of times each 


sub-process is executed by the specified personnel and systems for that sub-process. 


‘Times performed in a year’ of ‘After RFID’ was calculated from the ratio 
of time to completion between ‘Before RFID’ and ‘After RFID.’ The ratio is two times 


in the ASW case and 1.41 times in the 40th Supply Depot case study. 
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e Average Time to Complete 


The average time to complete is an estimate of the average time needed 


for a person in each process to complete each task. This data feeds the cost estimate. 
° Automation Tools 


Automation tools means the automation method embedded in the process 
such as computer program and IT. The MND has used the Defense Information System 
(DIS) since 1995 to request supplies. The automation tools aid in the completion of each 


process. 


e Knowledge(Learning Time) Per Process 


(Knowledge/process = Human Learning Time + Human Learning 
time* % Automation) 


Learning Time (Knowledge) was calculated based on the ratio of Human and 
IT. Fore example, an employee needs 1.5 hour to learn to perform a process with 50% 
automation. The calculation should be ‘1.5hours + 1.5hours*50% = 2.25hour’ since he, 


theoretically, has to learn how to do the work in place of IT if the IT system goes down. 


e Total Knowledge(Learning Time)/Year 


(Total Knowledge = Learning time * Times performed in a Year) 


Total knowledge represents the amount of knowledge embedded in the sub- 
process. It is determined by multiplying the total learning time by the number of times 
performed in a year when a market comparable estimate is approximated, it is possible to 


get the price per common unit of learning time (1.e., output). 
e Return On Knowledge (ROK) 


The aggregate ROK is the ratio between the total revenue and the total 
cost for the process. This ratio allows for comparison of expenses and revenues 
associated with the embedded knowledge assets. This ROK will be used to compare 
efficiency in performance among sub-processes and thusly assist in determination of 


relative value. 
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The numbers in the ROK column can be used as the reference in 
determining which sub-processes are providing the least or the most amount of value in 
the overall process. This result gives an insight on how to choose among the following 
options: deleting them, merging them, increasing IT usage, increasing the number of 


iterations, or increasing their value by making them more efficient. 


b. Assumptions 
e Market Comparable Approach 


The authors will use ‘Market Comparable approach’ since the MND is a 
non-profit organization. In terms of the ROI, the MND does not have a definite revenue 
indicator whereas private sector does. Furthermore, while the overall functions of the 
MND may not have market forces compared to the private sector, organization have 
similar core processes that produce comparable outputs. This allowed the authors to use 
the market comparable labor costs for estimating the revenue produced in the MND 
(Housel, Rodgers, Tarantino, and Little, 2007). Because the price per unit, at a given 
market comparable rate, is a constant, revenue is directly proportionate to amount of 
outputs. This makes the impact of biases in market comparable estimates irrelevant to the 


resulting relative values of the ROI ratios. 
e Market Comparable Revenue 


The authors use the current military wage as the base to produce ‘Market 
Comparable Revenue’; the authors multiply the military wage for enlisted men by 7 and 
the others by 1.5. Table 9 depicts the current military wage in the MND (the MND 


military personnel salary, 2007). 
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Table 9. = Military Labor Cost 


Yearly Market Comparable Market 
salary/hr($) ($) comparable/hr ($) 


Pay Grade | Yearly Salary($) 





E $3,000 $1.44 
Sl $15,640 $7.52 
$2 $26,490 $12.74 
83 $37,695 $18.12 
S4 $49,422 $23.76 
WO $49,992 $24.03 
Ol $18,984 $9.13 
O02 $20,683 $9.94 31,024.50 $14.92 
O03 $30,000 $14.42 45,000.00 $21.63 


Assumption : Hourly wage = Base Pay /(260 working days in a year * 8 working hours per day) 


21,000.00 $10.10 
23,460.00 $11.28 
39,735.00 $19.10 
56,542.50 $27.18 
74,133.00 $35.64 
74,988.00 $36.05 
28,476.00 $13.69 
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Hence, ‘Market Comparable Revenue Per Year’ will be ‘Market 


Comparable Revenue Per Hour’ times “Times Performed in a Year.’ 
e Market Comparable Labor Rate 


The authors derived the ‘Market Comparable Revenue’ based on what the 
market would pay civilians producing the same output. As such, the authors multiplied 
by 7 for the enlisted men and by 1.5 for the officers to compensate for the civilian wage 
gap. Table 9 shows the calculation used in the model. This data was aggregated to get 


the total revenue surrogate estimate and then allocated to the common units of output. 
° Times Performed in a Year 


The authors assume that ‘Times Performed In a Year’ in ASW for ‘After 
RFID’ is twice that of ‘Before RFID’ under the calculation that ‘Average Time to 
Complete’ in entire process of ‘After RFID’ decreased two times more than that of 
‘Before RFID.’ In the case of the 40th Supply Depot, the ‘Times Performed In a Year’ is 
1.46 times more than that of ‘Before RFID.’ In both cases, the authors applied the 


multiplier to the “Times Performed In a Year’ of ‘After RFID’ conservatively due to the 
4] 


specialty of the Military circumstance: how much service the military provides. In that 


case, there are no requirements other than doubled demand. 


> Input Data Analysis 
a. ASW KVA analysis 


Even before RF-AIS, the ASP of MND had used AIS for ammunition 
distribution process. Due to this electronic procedure, the working efficiency was higher 


than manual work. 


However, there are still several redundant sub-processes that reduced 
potential efficiency. RFID was used in an attempt to get rid of these redundancies and 
other inefficiencies. After RFID implementation, both the ROK and ROI were highly 


increased by the new system. 


The major change is the introduction of RFID technology. Even though 
not all sub-processes would be affected by RFID technology, the ROK of IT of most of 
the sub-processes increased and the output noticeably increased, as the value in Table 11 
shows. Two sub-processes were eliminated by RFID implementation due to immediacy 


of the real time information sharing. Table 10 shows the ROK and ROI of IT. 
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Table 10. | Comparison ROK of IT in Each Process 


Before RFID After RFID 





Process it IT 





ROK ROI 





1. Sending Requirement Paper (R.P.) of Ammo. ee 28% 


2. Receiving R.P. & Drawing up A.P.(Approving Paper) 





2114% 2014% 





3. Transmitting the A.P through wireless system 651% 551% 





4. Proceed to ASP 2% -98% 





5. Designating & A.S N/A N/A 


oe AS Arrival 90% ve 








6. Movement to A.S.W 0% 0% 





102% 2% 





7. Loading ammo. 








N/A N/A 
8. Confirm 


Signing to confirm (Battalion) 1054% 





9. Return to Base 0% 





339% 

















The additional automation of the “Loading ammo’ sub-process had a 
major positive impact on both the ROK and ROI of most of sub-processes. RFID 
technology eliminated the two processes: ‘Designating ASW’ and ‘Signing to confirm 
(Company)’ sub-processes. 

Especially, the authors tried to focus on the difference of IT ROI between 
‘Before RFID’ and ‘After RFID’ to confirm the positive effect of RFID implementation. 
As shown in the above table, the difference of the ROI about IT was more than doubled 
on average. 

Especially, in the ‘Signing to confirm (Battalion)’ process, the ROI soared 
from 2% to 954%. This means that this process benefited remarkably from the RFID 


implementation. Also, this result can be explained by the very large revenue increase 


produced by RFID technology regardless of the additional cost of the RFID technology. 
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Furthermore, the ‘Signing to confirm (Company)’ sub-process was consolidated into 
‘Signing to confirm (Battalion)’ sub-process. This consolidation reduced the workforce 


and increased the productivity. 


Table 11 shows the total ROK and ROI including human revenue and cost. 
This table also gives information about relationship between revenue and cost as well as 


about influence of revenue and cost on the ROI. 


Table 11. | Comparison Total ROK (Human & IT) 


Total (Human & IT) 





Process Before RFID After RFID 





Revenue Cost Revenue Cost 


1. Sending Requirement 
Paper (R.P.) of Ammo. 


2. Receiving R.P. & Drawing up 
AP. 


3. Transmitting the A.P 
through wireless system 


$ 241,801 $ 22,040 1097% 997% $ 30,747 1783% 1683% 





$ 453,012 $ 23,857 1899% 1799% ‘ $ 34,381 2987% 2887% 





$ 139,552 $ 17,985 716% 676% B 3 $ 22,636 1397% 1297% 





4. Proceed to ASP $ 5,039 $ 100,310 5% -95% $ 100,620 10% -90% 





5 46,310 20,526 226% 126% N/A N/A N/A 
5. Designating & $ : : 


A.S Arrival 
parva A.S Arrival ; 5 4 $ 20,136 | 217% 117% 


6. Movement to ASW $ 10,305 $ 2,061 $ 1,099 1875% 1775% 








7. Loading ammo. $ 88,885 $ 16,666 5 3 $ 157,921 203% 103% 





$ 23,155 $ 18,210 N/A 





8. Confirm Signing to 


confirm $ 51,244 $ 18,944 5 511,921 $ 23,872 2144% 2044% 
(Bat.) 


9. Return to Base $ 3,876 $ 1,938 $ 7,753 $ 3,876 





Total $1,063,604 $ 242,792 $ 2,805,319 $ 395,288 





























After implementation of RFID, the ROK and ROI of most sub-processes 


increased on average two times higher than ‘Before RFID.’ 


In contrast, the ROI of the ‘Loading ammo’ sub-process is lower 
compared to the other sub-processes. It seems that the IT had a negative effect on this 


sub-process because of its high cost relative to the prior approach. 
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However, the other factor that is also one of the numerators—revenue— 
should be explored. It is important to note that the amount of output increased 
enormously. The output from RFID is four times higher than before; the revenue of 
‘Before RFID’ is $88,885 versus the revenue of $319,988 for ‘After RFID.’ RFID 
technology produced a high amount of output in this specific sub-process. The huge 
amount of output results in high revenue. The cost estimate for RFID implementation is 
based on one-year use of RFID. The high cost should go down significantly as RFID tags 
and readers become cheaper following the normal pattern of other consumer based 
information technology (e.g., computer chips, cell phones and televisions, etc.) (J. H. Lee, 


2005, p. 84). 


b. 40th Supply Depot Before RFID 

Data analysis obtained from the ‘Before RFID’ inventory process shows 
that sub-processes that use the existing software (DIS) deliver relatively high total ROL 
Even though human cost in sub-processes 3, 5, 7, 8, 9, and 10 have negative impact on 
the ROI, sub-processes 2 and 6 with most of employees (enlisted men) provide high ROI 
since their actual output is much more than other sub-processes Subsequently, the total 
ROI delivers 182% because of these sub-processes showing a high revenue-to-cost ratio. 


Table 12 shows the ROI of each sub-process. 
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Process(Before RFID) 


Table 12. 


Before RFID Inventory Process 





Revenue 


Cost 


Revenue 





1. Print inventory worksheets 





36,118 


4,816 


$ 
18,059 





2,975,690 


743,923 





6,567 175,118 





65,669 21,890 





14,447 48,157 


-85% 





2EONP 25,000 


9. Print final inventory $ 
discrepancy report 2,189 oe 25,000 








10. Print master inventory listing 2,189 -85% 25 an 


$ 
150,000 





Total 3,238,347 1,019,676 218% 


























* Sub-processes that are eliminated with RFID are 2, 3, 4, 6, 7, and 8. 





According to the above data analysis, the sub-processes that show minimal 
ROK and ROI could be potential areas for improvement. For example, the performance 
of sub-processes 3 and 7 were highly improved after the implementation of RFID (see 


Table 13). 


ra 40th Supply Deport After RFID 


The following data analysis shows the ROK and ROI based on real post- 
RFID implementation data, as the 40th Supply Depot implemented the RFID system in 
2005. * Sub-processes 3 and 7 delivered low ROK and ROI before RFID was 
implemented. With the RFID technology implemented, the two sub-processes were 
integrated with sub-processes 2 and 4. With the implementation of RFID, the 40th Supply 
Depot decreased processing time by 41% in ‘After RFID’ and, more importantly, reduced 


its labor force from 56 employees to 18 employees because RFID replaced those 


4 «After RFID’ data is based on the real data since the 40" Supply Depot has used RFID for five years. 
However, ‘Before RFID’ data relies on the memory of Subject Matter Expert (SME). 
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employees. Furthermore, the technology also enhanced the frequency and accuracy of the 
inventory output process. Table 13 depicts the ROK and ROI on each sub-process of 
‘Before and After RFID.’ 


Table 13. Comparison Total ROK (Human & IT) 


Total(Human & IT) 








Process 





ROL Revenue 
1. Print inventory worksheets EB , 82%| $ 76,392 , 172%] 
300% 
A 3.439.097 1182% 
110% 
5. Print inventory discrepancy report i; , é -710%| $ 27,779 is 28% 





























700% 


MS s 151.438 479% 


-80%| 

9. Print final inventory discrepancy report f -987%| 694 2% 

10. Print master inventory listing -98%| $ 694 , 2% 
5S 


$ 3,298,434 | $ 1,169,676 [D827 I8294| $3,696,09: 


*Sub-processes 2, 3, 4 and 6, 7, 8 in ‘Before RFID’ are integrated into sub-process 2 and sub-process 4 of 'After RFID' respectively . 

































































Implementation of RFID at the 40th Supply Depot reduced total cost due 
to huge labor cost saving while total revenue increased. It led to 394% ROI increase from 
‘Before RFID’; total revenue increased to 1.12 times whereas human cost decreased to 
2.8 times. On top of that, IT output increased to 27 times whereas IT cost increased to 
1.25 times. To sum up, the ROI increases from a ‘Before RFID’ of 182% to an ‘After 
RFID’ 576%. This is a total improvement of 394% in ROI. 


The estimate is based on the performance of one supply depot. There are 
four more supply depots in the RoK Air Force. Accordingly, the obtainable revenue from 
four more facilities through RFID implementation should increase in spite of IT cost 
increase. IT cost used in the above worksheet was based on a one-year cost through 
amortizing the total IT cost over the fifteen-year life cycle and taking into account Net 
Present Value (NPV). Considering the potential precipitous decrease of RFID cost, the 
ROI through RFID in the 40th Supply Depot should exceed current ROI. 


The reason that sub-process 4 delivers lower ROI than sub-process 2 
despite the same IT (RFID) cost is that sub-process 4 is performed 17 times in a year 


whereas sub-process 2 is done 372 times in a year, which results in higher revenue to cost. 
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B. COMPARATIVE ANALYSIS 
1. Two Case Studies in the MND: ASW and 40th Supply Depot 


This study provides ROI hurdle rates as shown in Table 14 and IT ROI 


comparison as shown in Table 15 from the two case studies in the MND. 


From both the ASW and the 40th Supply Depot case studies for similar kinds of 
warehouse logistic operations that have the potential to improve using RFID technology, 
the authors can set a notional improvement range from 272% to 394%.5 Table 15 shows 


the aggregate ROIs from both cases before and after RFID implementation. 


Process 


Table 14. 


Hurdle Rate of ROI from Two Case Studies 


ASW case study 


40th Supply Depot case study 





Before RFID 


After RFID 





ROI 


ROI 


Before RFID 


After RFID 





ROI 


ROI 








338% 





610% 








182% 





576% 








Hence, this range value can provide an expected performance improvement range 
when the decision-makers consider expanding the implementation of RFID to other 


MND logistic operations that might use RFID. 


Comparison of IT ROI improvement based on this research can also be useful to 
decision-makers who want to estimate the ROI of implemented IT and prospective IT 
investment. Table 15 shows the comparison of ROI on IT of the two facilities in this 


study. 


5 ROI of 272% is calculated by subtracting ROI of 338% from ROI of 610% in ASW case and ROI of 
394% is calculated by subtracting ROI of 182% from ROI of 576% in the 40" Supply Depot case. 
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Table 15. 


Process 


ASW case study 


Comparison of IT(RFID) ROI from Two Case Studies 


40th Supply Depot case study 





Before RFID 


After RFID 





ROI 


ROI 


Before RFID 


After RFID 





ROI 


ROI 


ROI 
Gap 





Total 


60% 


239% 


-60% 


765% 


825% 























In the case of ASW, the difference of the ROI between before and after RFID is 
179%, which is comparatively low compared to the 40th Supply Depot case. However, 
the numerical values in both cases show the increasing ROI rate with RFID 


implementation. 


As for the 40th Supply Depot, the remarkable increase of IT ROI was caused by 
the fact that the output in sub-processes 2, 3, and 4 in ‘Before RFID’ was transferred to 
sub-process 2 ‘After RFID’ was implemented; likewise, the outputs of sub-processes 6, 7, 
and 8 in ‘Before RFID’ were transferred to sub-process 4 of the implementation of RFID. 
This means that even though the employees were reduced in ‘After RFID,’ their outputs 
were produced by the RFID technology. This contributed to the increase of 6.6 times IT 
revenue from $60,087 to $396,095 with IT cost increasing 1.26 times from $150,000 to 
$188,494. 


Ze Comparison of the Current Study to Previous RFID-based Research 
at the Naval Postgraduate School (NPS) 


The two previously reviewed prior studies were by Courtney (2007) and analyzed 
almost the same processes as those found in the ASW case and Obellos et al.; (2007) 
study examined very similar processes to the 40" Supply Depot. Table 16 shows the 
comparison of the projected ROIs from the previous studies and actual ROIs from the 


current study. 
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Table 16. | Comparison of Overall ROI between the MND and NPS Case Studies 
ASW 


Item-Level 


40th Supply Depot 


RFID/UID 





Before 


After 


Before 


After 


Before 


After 


Before 


After 





338% 








610% 





-73% 





44% 





182% 





576% 





-19% 








133% 


The overall ROIs of the MND cases were based on real data for ‘To-Be.’ It was 


almost two times that of NPS projected ROIs for “To-Be’ models. Accordingly, the 


authors may assume that the students at NPS projected the benefit for the “‘To-Be’ model 


too conservatively. The ROI projected by the previous NPS research actually may reach 


the ROI that the authors provided from their research. Decision makers who might 


operate on the basis of the ROI estimates from the prior two studies may expect even 


higher ROIs based on the real ROIs from RFID implementations from the current study. 
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V. CONCLUSIONS AND RECOMMENDATIONS 


A. CONCLUSIONS 


With the MND defense budget decreasing, it is important that military decision- 
makers find the methods to evaluate new IT acquisition projects. This shrinking defense 
budget forces the MND to find new ways to make current processes more efficient. RFID 
has the potential to improve core logistics processes. This study provides a representative 


example to demonstrate a new approach to estimate its potential ROI. 


However, the problem has been how to measure and demonstrate the benefit of 
RFID objectively. For these reasons, the leadership of the MND should use valid and 
reliable methods to quantify the actual benefits and projected benefits of new technology 
investments. Such methods can ensure that the defense budget is prudently being used. 
Within this context, the use of the KVA as a methodology to evaluate the benefit of RFID 
implementation is promising. As detailed in the literature review, the KVA is arguably 
more objective than the alternative (BSC) that the MND has used in the past to evaluate 
RFID. Over 150 fifty organizations in the public and private sectors have applied KVA 
for the past 17 years to provide new performance information enabling innovative 
perspectives for the decision makers (Rios et al, 2006, p. 9). The authors have 
demonstrated how it can be used to evaluate RFID in the MND, and potentially, 
throughout the MND to evaluate future IT acquisitions. 


Using the two case studies with the KVA methodology, the authors examined the 


following objectives. 


1. Introducing and Applying KVA Theory as a Framework 


Since 2005, the MND has used RFID technology in the Ammunition Storage 
Warehouse and in the 40th Supply Depot. Even though the MND has had a Performance 
Evaluation Conference (PEC) to measure the performance improvement by the 
implementation of RFID, the authors believe that it did not have an objective way to 
estimate the ROI. The only approach used to attempt to estimate the ROI on RFID was 


the BSC approach. However, the BSC approach is not designed to estimate the ROI. 
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The most important feature of the KVA is that it can quantify the value 
resident in human and IT assets in terms of common units of output. With common units 
of output, it becomes possible to compare the performance of all productive assets 


including IT. 


The authors got the necessary data for the KVA analysis through a KVA 
survey for data collection (See Appendix III), which took two to three weeks. It took 
three to four weeks for the authors to analyze the performance for RFID through KVA 
methodology based on the survey results, which means the total cycle time for 
performing analysis and interpreting data was six to eight weeks. Given the MND 
leadership’s impatience with time-consuming performance measurement efforts, this 
indicated that the technique would be feasible to use on a variety of processes that might 


use RFID technology within a reasonable cycle time. 


2. Providing Hurdle Rate 


The authors were able to develop the preliminary bases for a notional hurdle rate 
from the two case studies for the ROI expectation using RFID technology. However, 
many more studies are required to develop a portfolio of projects from which a more 


precise hurdle rate could be derived per the prior discussion of hurdle rate in Chapter IV. 


As an example of how a hurdle rate for such projects might be developed, the 
authors combined the results from both studies into a single ROI estimate of 209%. That 
is the ROI of 209% that is the baseline return without using RFID technology. Multiple 
‘Before RFID’ ROI estimates would provide the volatility information required to 
develop an eventual hurdle rate. The ‘After RFID’ implementation ROI estimate of 380% 
could be used to set expectations for the kind of improvement to expect from using RFID 


technology. 
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Table 17. Aggregate ROI 


Before 








ASW 
$4,362,038 | $1,412,468 | 209% | $6,501,414 | $942,428 | 589% 
40th SD 


The hurdle rate could be developed after doing numerous studies that could 


be used as a reference point for decision-makers of the MND when considering future 


investments in RFID technology to improve logistics processes. 


3. Comparing the ROI Based on the Real Data by Using KVA 


One of the unique aspects of this research is that it is based on the real RFID 
implementation data, not projected data like the previous two studies performed at NPS. 
As mentioned before, the MND adopted RFID in 2005 and it has entered the stable state 
in perspective of managing inventories using RFID. These results also suggested that 


projected improvement from RFID technology in the DoD may be overly conservative. 


B. RECOMMENDATIONS AND LIMITATIONS 
1. Expansion of RFID Technology 


The two processes analyzed by the authors provide limited support for the idea 
that the MND should continue to use RFID technology to improve current logistics 
processes that may benefit from implementation of this technology. Specifically, as it 
was analyzed in this project, the KVA has shown a noticeably increased ROI after using 
RFID in the inventory checking process at the 40™ Supply Depot and in the ASW 
inventory process. However, more research is needed to assess the impact of RFID 


across the MND before definitive conclusions can be drawn. 


33 


25 Introduction of KVA Methodology to Measure the ROI 


The authors recommend the use of the KVA methodology because it is simple 
and fast to use and generates defensible ROI estimates. Although its application was 
difficult enough that the initial scope of this research needed to be redefined, the authors 
believe that, once learned, the application of KVA is simple and fast, compared to other 
alternatives they might have tried. In addition, considering that the MND is a non-profit 
organization, the KVA can be a good tool since it can provide a common unit of output 


that can be used to determine the value added of various technologies in the public sector. 


For these reasons, the KVA provides a viable option to estimate the ROI of new 
IT such as RFID. Hence, the authors recommend that the MND use KVA as a framework 


to estimate the ROI of IT as well as the ROI on core-processes in general. 


“No measurement methodology, however useful, can replace the creative insights, 
judgments and intuition of managers and investors. KVA is no exception to this rule and 
should be used as a decision support tool’(Housel, & Bell, 2001, p. 106). According to 
this statement, the use of KVA should have a primary goal to “establish a common 
framework within the DoD [and the MND] for understanding, evaluating, and in the end 
justifying the impact of government investments” into existing as well as future projects 


and programs for the two organizations (Rios, 2005, p. 46). 


3. Further Research Using KVA+RO (Real Options) Framework 


From the perspective of the MND, it is important to manage these IT portfolios 
that include IT such as RFID technology investments and GPS system investments. IT 
portfolio management is designed to maximize the benefit and minimize the risk of IT 


investments. 


Housel and Mun created the KVA+RO valuation framework, which can express 
the uncertainty and risks in the potential value of IT options and which provides a way to 
reduce the risks through analyzing potential strategic investments over time (Seaman, 
Housel, & Mun, 2008, p. 47). The authors analyzed the ROI of RFID, which can be used 
as the historical data set necessary to perform the RO analysis to find the most valuable, 


and least risky, options. 
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If the MND applied the KVA+RO framework to manage its IT portfolio, it could 
come up with better investment options. The MND can achieve effective and efficient use 


of the defense budget by this analytical process. 


aS) 
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A. 


‘BEFORE RFID’ IN ASW 


APPENDIX I 






















































































































































































































































































Pr Number of Rank of RLT(hr) ALT(hr) Percentage Times performed | Average Time Knowledge(hr)/ Process Total Kr Human ITcost/r Ritorction Teale 
Employees(Total Difficulty Automation ina year to complete Human IT Cost/Yr 
1. Sending Requirement Paper (R.P.) of Ammo. 5 11 20 3 50% 84 05 15 7.5) 1s90| $ 5,373] $16,667] Software Program 
2. Receiving R.P. & Drawing up A.P.(Approving Papi 7 10 22 3 50% 84 0.5 21) 10.5 2646|$ 7,191| _$16,667| _ Software Program 
3. Transmitting the A.P through wireless system 4 9 22 3 50% 84 0.17 12) 6| 1512|$__1,318| _$16,667| Software Program 
4. Proceed to ASP fe 2 3 5 O5 30% f 84 0.08 1 0.3) 109.2] $ 310] $100,000 | Gate Checking Program 
5 Desienatine & As ri nS 4 8 7 1 50% 4 Os | 2I 504[$__3,859| $16,667] Software Program 
AS Arival 1 2 3 05 % 84 03 o5| o| 42|$_ 254 $o 
6. Movement to A.S.W ig 3 1 3 0.5 o% | 84 03 15] 0} 126] $__2,061 so 
7. Loading ammo. f 8 7 3 1 om - 84 15 3 Ol 672| $ 16,666 SO 
pom 4 4 3 05 so%  [ 84 02 2 1 252] $ _1544|_$16,667| Software Program 
Signing to confirm (Batalli 6 5 4 05 50% 84 0.2 3] 15 378|$ _2,277| _$16,667| _Software Program 
9, Retum to Base 2 6 8 05 o% 84 05 1 ol eats 1938 $0 
Total 
Human IT Total 
Process 
Revenue Cost ROK ROI Revenue Cost ROK ROI Revenue Cost ROK ROI 
1 Sending Requirement Paper (R.P.) of Ammo. $ 161,201 | $ 5,373 3000%| — 2900%| $ _30,600/$ 16,667 484% 384%| S$ _241,801|$ 22,040 1097%] 997%] 
2. Receiving R.P. & Drawing up A.P.(Approving Pap| $ 302,008 | $ 7,191 4200%|  4100%| $ 151,004 | $ 16,667 906% 806% $ _453,.012|$ 23,857 1899%] 1799%| 
3. Transmitting the A.P through wireless system —_| $ 93,035 | $ 1,318 7059%| _ 6959%| $__46,517| $ 16,667 279% 179%| $ _139,552|$ 17,985 776% 676% 
4. Proceed to ASP $ 3,876 | $ 310 1250%| _1150%| S$ 1,163 | $ 100,000 124) 99% $ 5,039|$ 100,310 5%| -95%| 
5 Desienating & As ari nS $ 30,873 | $ 3,859 800% 700%| $ _15,437| $ 16,667 3% -%$ _46310|$ 20,526 226% 126% 
AS Anival $s 424|$ 254 167%! 67% $ = $ = $ 424/$ 254 167% 67% 
6. Movement to A.S.W $ 10,305 | $ 2,061 500%| 400%] $ - [s - $ 10,305 | $ 2,061 500%] 400% 
7. Loading ammo. s 88,885 | S$ 16,666 533% 433% S -_[s - $ 88,885|$ 16,666 533%] 433%| 
Se $ 15,437 | $ 1544 1000%| 900% $__7,718| $ 16,667 4624 “54% $ -23,155|$ 18,210 127% 27%) 
Signing to confirm (Batalli $ 34,162 | $ 2,277 1500%| _1400%| $__17,081| $ 16,667 102% 2%] $ 51244|$ 18,944 270% 170% 
9. Retum to Base $ 3,876|$ 1,938 200%| __-100%| $ - [$s - $ 3,876 | $ 1,938 200%] 100% 
Total $ 744,083 | $ 42,792 1739%| _1639%| $_ 319,521] $ 200,000 160%| 60%| $ _1,063,604| $ 242,792 
CORRELATION: Qraer of Difficutty to Actual Learning Time 0.84338 
CORRELATION Relative Learning Time to Actual Avg Training 0.967057 
Pay Grade Knowledge(%) 
E $3,000 1.44 $__21,000.00| $10.10 Human IT 
$1 $15,640 $7.2 $23,460.00| $11.28 66.67%| 33.33%) 
S2 $26,490 $1274 $ 39,735.00 $19.10 66.67% 33.33%] 
S3 $37,605 18.12 S$ 56,542.50 $27.18 66.67% 33.33%] 
s4 $49,422 $23.76 $_74,133.00| $3564 76.92% 23.08%) 
wo $49,992 $24.08 $74,988.00]  $%05 66.67%] 33.33%) 
O1 $18,984 $2.13 $ 28,476.00] $136@ 00.00% 0.002%] 
o2 $20,683 $9.94 $ 31,024.50| g14.90 100.00%| 0.00% 
o3 $30,000 14.42. $ 45,000.00 $21.63 00.00% 0.00% 
66.67%] 33.33%) 
Note : Hourly wage = Base Pay /(260 working days in a year * 8 working hours per day) 66.67% 33.33%] 
100.00%| 0.0024] 
E s2 s3 s4 wo OL o2 O38 
Yearly Salary $3,000 $26,490 $37,695 $49,422 | $49,902 | $18,984 $20,683 $30,000 
Yearly Salary/hr $1.44 $12.74 $18.12 $23.76 $24.03 $9.13 $9.94 $14.42 
Mkt revenue/hr $10.10 $11.28 $27.18 $35.64 | $36.05 | $13.69 $14.92 $21.63 















































B. 


‘AFTER RFID’ IN ASW 
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Process Number of Raris of Rutty) | ALT(hy) Percentage ne performed] Average Time | Knowledge(hr)/ Process Total K/vr Human ITcost/Yr sa teyrctiGa toole 
Employees | Difficulty Automation ina year to complete Human IT Cost/Yr 
1. Sending Requirement Paper (R.P.) of Ammo. r 5 8 20 3 70% r 168 (eke) 15 10.5 4284, S$  10,747| S 20,000 | Software Program 
2. Receiving R.P. & Drawing up A.P.(Approving Pape{ 7 9 20 3 70% r 168 0.5 21 14.7 5997.6] $ 14,381] $ 20,000 || Software Program 
3. Transmitting the A.P through wireless system 4 6 16 3 70% [ 168 0.17 12) 8.4 3427.2| $ 2,636 | S 20,000} Software Program 
4. Proceed to ASP f 2 3 2 05 30% | 168 0.08 1 03 218.4] $ 620] $ 100,000] Gate Checking Program 
AS Arrival 1 4 3 15 70% 168 0.08 15 1.05 428.4| $ 136]$ 20,000|} Software Program 
6. Movement to AS.W f3 2 3 0S o% [168 0.08 15 0 2521$ _1,099| $ : - 
7. Loading ammo. And Real Information transmitti 8 7 9 1 80% r 168 0.83 8 6.4] 2419.2) $ 18,444 | S 139,477 RAID 
8. Confirm 0 - 0 0 0% : 0 ie} 0} 0} os - Ss - - 
Signing to confirm (Batalliq 6 5 24 1 70% 168 0.17 6| 4.2 1713.6] $ 3,872|S 20,000} Software Program 
9, Retum to Base [2 1 3 05 of 168 as 1 q 16s] $__-3,876| $ z 
Ta a 
Human IT Total 
Process 
Revenue Cost ROK RO! Revenue Cost ROK RO! Revenue Cost ROK RO! 
1. Sending Requirement Paper (R.P.) of Ammo. S$ 322,409|$ 10,747 3000%|  2900%|S  225,686|S 20,000 1128%| 1028%| S$ 548,095|$ 30,747 1783%| 1683%| 
2. Receiving R.P. & Drawing up A.P.(Approving Pape| S$  604,029|$ 14381 4200%| 4100%}$ 422,820] $ 20,000 2114%| 2014%| $ 1,026849/S 34381 2987%| 2887%! 
3. Transmitting the A.P through wireless system S$  186077|S 2,636 7059%| 6959%} S$ 130,254|$ 20,000 651% 551% S  316331|/$ 22,636 1397%| 1297%| 
4. Proceed to ASP s 7,753 | $ 620 1250%| 1150%| $ 2,326] $ 100,000 2%| -98%| S 10,079 | $ 100,620 10% -90%| 
5. Designating & AS Arri ; $ aa ves oe he - $ a: ae 
AS Anival s 25,701 | $ 136 | 18941%| 18841%] $ 17,991|$ 20,000 90%| -10%| $ 43,693| S$ 20,136 217% 117%| 
6. Movement to A.S.W s 20,611} $ 1,099 1875%| 1775%) $ - S - s 20,611}$ 1,099 1875%| 1775%| 
7. Loading ammo. S$ 177,771|$ 18,444 964% 864%] S$ 142,217] $ 139,477 102% 2%|S 319,988} $ 157,921 203% 103%| 
8. Confirm $ - |S = 0% 0%| S - |$ = $ = [$ * 
Signing to confirm (Batallid S$  301,130|$ 3,872 7778%| 7678%|S  210,791| $ 20,000 1054%| 954% S$ 511,921] $ 23,872 2144%| 2044%| 
9. Retum to Base s 7,753|S 3,876 200% 100%} $ = $ = s 7,753|S 3,876 200% 100% 
Total $ 1,653,234[$ 55811] 296294 2862%] $ 1,152,085[$ 339,477 330% 230% $ 2,805,319 | $ 395,288 ec 
CORRELATION: Order of Difficulty to Relative Learning Time 0.749227 
CORRELATION: Relative Learning Time to Actual Avg Training 0.755667 
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LCC OF REF-AIS IN ASW 




















































































































$ 29,881,818] $ 5976064) $ 5976.964]$ 59769641 $ 5976964) $ 5976364] $ -|$ $ -|$ -|$ -|$ -|$ -|$ -|$ - | $ 29,881,818) 77.69% 
$ 8081,818/$ 8,081,818 -|$ -|$ -|$ -|$ $ -|$ -|$ -|$ -|$ -|$ -|$ -| $ 801,818] 18.88% 
$ 468%) $ - 26713 27515)$ 28340}$ 2190/$  30066/$ mB] $ 31897|$ 284)$ w8% W855 35900|$  6977|$ 38087/$ 3929/$ 40406) $ 4968%| 1.53% 
T 
$ 26,460,472 | $ 14,058,182) $ 6008077] $ 6003878} $ 6004704) $ 6005554) $  30,066/$ 30%8)$ 31897|$ 284)$ we0 W855 36900|$  6977/$  38087/$ 39,29) $ 40,406) $ 38.460,472) 98.11% 
$ 42,802,508 | $ 14,620,509) $ 6492928]$ 67535461$ 7.02464) $ 7,406674]$  3308/$  4072/$ 43,653|$  46761|$ 50,091 58.657 57477|$  61,570/$  6594/$ 70,650) $ 75,680] $ 42,802,508 
$ 2437,915 | $ 13,171,690] $ 5,260,806] $ 4938135] $ 4,627,957] $ 4336156; $  20500/$ 19.628] $ 18942|$  18280/$ 17,641 17,004 16429/$  15855}$  15901]$  14,766]$ 14,250] $ 32437915 
$ 13,171,690 | $ 18.441,496] $ 23,379,571 | $ 28,006.928 | $ 32.343.083| $ 22,963.423|$ 32.983051 32,401,998 | $ 32,420,273 | $ 32,497,915 | $ 2,454,990 | $ 32,471,368 | $ 32,497,224 | $ 32,502,524 | $ 22517,291 | $ 32,531,540] $ 64,960,455 
From’05 7. Logistics Management Deparement 
$ 42802508 
FFID Pecks Compute Facity/] PAS 
i Tay | Itdaicncos | Soa 
$ 2497915 Inflation rete = 4% POTE cost 
Discount rate = 8% $ 37,963,636] $ 24881,818|$ — 5,000,000|$ 8,081,818 




















¢ Assumptions 
Life Cycle: 1 yr of R&D+ 15 yrs of O&M 
Total 7 units for Implemenation 






































From''06 KNDU Thesis "An Economic Analysis for RFID Pilot Project in the Defense Ammunition Field" 


















































(Operations & IMaintenance Cost) 

FY Cost 

2006 «| $)=—(26,713| 29,384,465 
2007 «| $27,515] WF 30,265,999 
2008 «= |$ —28.340|¥#F—31,173,979 
2009 «=| $ ~——-29,190| ¥F_ 32,109,198 
210 =|$ —30,066| 33,072,474 
au | $ 30,968 | WF 34,064,648) 
12 /$  — 31897/¥ 35,086,588 
2013 «|S ~—-32854/¥F 36,139,186 
24 «| $33,839) #F 37,223,361 
21s | $34,855) ¥F 38,340,062 


























Nn 
\o 





THIS PAGE INTENTIONALLY LEFT BLANK 


60 


A. 


APPENDIX II 


‘BEFORE RFID’ IN THE 40TH SUPPLY DEPOT 



























































Process 





1. Print inventory worksheets 











Process Nurwen ot oles RLT(hr) ALT(hr) % Auto Tires performed |Average Time to|_Knowledige(hr)/ Process Total K/Yr(Hr) | Human Cost/Yr ITcost/Yr Automation Tool 
Difficulty inayear complete Human IT 
1. Print inventory worksheets 3 2| 2 a5| 50% 264 a2 15) az 594] $ 4,816| $ 25,000|software program 
16 10) 40! 2 o%| 264) 8 32) fe 8448} S$ 743,923] $ - 
3 7 4| a or 240] 3 a3] d 7 $ 175,118] $ - 
3 4 4| q 50% 240] Fl 3 15] 1080] $ 21,890] $ 25,000] software program 
5. Print inventory discrepancy report 3 3 1 a2| 50% 264 2 ag 03 237.6 $ 48,157| $ 25,000|software program 
16 E q 2 or 12| 4 32| | 384] $ 16,907| $ - 
3 5| 4| al | 12| 4 ag of 7.21 $ 4,378| $ - 
3 4 1 q 50% 12| a1 3 15] sal $ 109| $ 25,000] software program 
9, Print final inventory discrepancy report 3 Z| 2 | 50% 12| 2 a3| a5 5.4 $ 2,189] $ 25,000|software program 
10. Print master inventory listing 3 q 2 0.1] 50% 12 2 a3] 0.15] 5.4 $ 2,189] $ 25,000 | software program 
Total $ 150,000 
































S. Print inventory discrepancy report 


















































9, Print final inventory discrepancy report 














10. Print master inventory listing 











































































































































































































Total] 3,238,347 
Correlation Rank of Difficulty to Relative LT 0.819208223, 
Correlation Relative LT to Actual ALT 0.88536444 
knowedge(%) 
E $ 21,000.00 Human IT 
$3,000 $1.44 00} $10.10 7 = 
S2 $26,490 $12.74 [$ 39,73500| $19.10 100% oO 
$3 $37,695 $18.12 [$ 5654250| $27.18 100%4 © 
s4 $49,422 $23.76 [S$ 7413300| $3564 or ES 
wo $49,992 $24.03 [S$ 7498800[ $36.05 er 33% 
100%} oO 
Note : Hourly wage = Base Pay /(260 working days in a year * 8 working hours per day) 100%] oO 
674| 33% 
E s2 s3 4 Wo 674 33% 
Yearly Salary $3,000 $26,490 $37,695 $49,422 $49,992 67% 33% 
Nearly Salaryfr| $1.44 $12.74 $18.12 $23.76 $24.08 
Mkt Comp 
Rev/hr $10.10 $19.10 $27.18 $35.64 $36.05 






































B. ‘AFTER RFID’ IN THE 40TH SUPPLY DEPOT 
Number of | Rankof | Relative | Actual ; Times Average | Knowedge(hr)/ Process Human P 
esis employess | Difficulty | learning | Average ae performedina | Timeto | Human IT Toa Cost/Hr eee | Heanor 





1. Print inventory worksheets 


2 05 50%| 


372 
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2 15 0.75 


837.54 


91} $ 37,500 


software program 
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5. Print final inventory discrepancy report 


2 0.1 50%| 


17 


03 0.15 


7.614 


91} $ 37,500 


software program 





6. Print master inventory listing 
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Cost Revenue 
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1. Print inventory worksheets 


6. Print master inventory listing 
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$ 
$ 
4 reine POA Tarr Gave 2 
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50,928 


S$ 6,790 


0.3 0.15 











7.614 





$ 44,290 











91}$ 37,500 
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2,065,115, $ 1,630,980 $ 3,696,095 
Correlation Rank of Difficulty to Relative LT 0.788921861 
Correlation Relative LT to Actual ALT 0.978079067 
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1,910,610} $ 271,608 § 290,855) 1182% 
3. Print inventory discrepancy report 18,519) $ 61,729 § 27,779}S 99,229 
S 12,346 § 151,438}$ 31,593 
5. Print final inventory discrepancy report 463 694) $ 40,586 





software program 


a 





C. LCC OF RFID IN THE 40TH SUPPLY DEPOT 





































































































































































































$ 312,500 $ 312,500 48.08% 
$ 312,500 48.08% 
$ 25,000 $ 1,667) $ 1,667) $ 1,667) $ $ 1,667] $ 1,667| $ 1,667 | $ 1,667| $ 3.85% 
$ 660,000 $ 314167) $ 1,667) $ 1,667) $ $ 1,667] $ 1,667| $ 1,667| $ 1,667| $ 100.00% 
$ 699,096 $ 3398038) $ 1875}$ 1,950] $ $ 2,109) $ 2,193] $ 2,281 | $ 2372|$ 2467 
$ 577,413 $ 275,791|)$ 1,371) $ 1,284] $ $ 1,127] $ 1,066 | $ 990 | $ 927) $ 
$ 568,584 $ 569,965) $571,239 $ 573,570) $ 574,627|$  575616;$ 576,544) $ 577,413 
* Assunptions From’'05 7. Logistics Management Deparerment 
$ 699,096 Discount rate = 8% 
Total RFID Reader/ | Computet | RFID RDTE 
$ 577,413 Inflation rate = 4% Tea Facility cost 
life Cycie: yr of R&D $ 37,963,63636| ¢ 24,881,818.18 | $5,000,000.00 | $8,081,818.18 
1 Unit Total Lunit for implementation 
$ 577,413 From'06 KNDU Thesis "An Economic Analysis for RFID Pilot Project in the Defense Ammunition Field" 
$ 577,413 (Operations & Maintenance Cost) 
$ 38,494 
FY Cost 
2006 $ 26,713) ¥¥ 20,384,465] 
2007 $ 27,515| 3 30,265,999] 
2008 $ 28,340) W 31,173,979] 
2009 $ 29,190] ¥ 32,109,198) 
2010 $ 30,066] ¥F 33,072,474 
2011 $ 30,968] ¥F 34,064,648 
212 $ 31,897| WF 35,086,583 
2013 $ 32,854 |W 36,139,186 
2014 $ 33,839 | WF 37,223,361 
2015 S 34,855 |W 38,340,062 
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APPENDIX III 


Name: Major. Son, Jongwoo 
Job-Title: Director in 40" Supply Depot 


* HS USE AP EMOA ADAA Dol] Sststoj hast = AIO, 11 B 2 At 40 SSAHOWA RFID O|SFt 


ATi sol he Ass ose. 


Och FS SY AS Be Al Al St eePLICL (AS ASS) 


The following data are limited to inventory checking process. Further detail data on broad processes using RFID in 40" 


Supply Depot will be obtainable after 2"' week of November, 2009. 


A. AtQMareat: Zt Bate SBStEt input Zt output O] 2/010F Stet. 


OFAHS| VALS oWAlOl7| CH ZO] FAY 40 BOA] RFID O|S Ft AWD AA Wat (Process) SE Ch ALO|7} USS DeAs0 


Oo 
CHAS HS 4014] ZSA|AYO| output S SAHUEG Beet PEAS dil 


a! Pe=o Bes AZ. 
Zt BA = Hol] Be st Old (Number of Employees): 2f VAOl]AY WS D 2 


IK Of 
AL 


al 


fo} 
= 


ata) 
re 
mt 
>t 
mu 
Ho 
= 
ol 
1 
> 
nN 
4 
jm 
Toh 
vr 
n 


( Background 7AQgWess 


ACH He AG AlZt (Relative Learning Time): S 100 A\2'S ZIZCH 2 Bat FSA ACFE AWM BH AlZ (S, ‘D’ column L| S FE 100 AlZh) 
i—4 
— 


4p 
o2t 
ol 
rr 
inl 
b> 


C 

D om 
E. 2 Bat FAoll ALTE AlzZt (Average Time to Complete): 21 BAt(Process)M Z HE! Bt AZO] 24 ASF 
F. St SZt et H+: 2 WaAt(Process)7t HSZ MASE olla SI: UU et sF* 20M = 
G 
H 


. Ala (Pay Grade): 2$ BAt(Process)Ol] S34 VE TS el(Employees)e!S 2] Ala 


Qe ols alzt 


. ZF BRO] LO] HA (Rank Order of Difficulty): 1= 7/2412 Wat, n=7-S US (SB BAtQ| 7AM) HAL 1 HEY n AA] BAI, MALO n=10) 


I. AbS St (Percentage Automation) %: 2 “At (Process) 2| AS St ALS HSE AltA 


J. Hla: 2 Bapol oS ze USS F7t SSO| Dost us 7 
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A. RFIDAS YADAA 
A B c D E F G H I J 
2} ah SSS 
; erat, 2b at Hol AHA te AS Zt Wat + Hol a 2! See) Zt Wat ol e 
y | Suuten | ewe wise hte fe en on me wocey | *S8% | ul 
4 kd > tm I Sd 
ws (Process AQEE of AtAlZk (hrs) Ree ee pen ane Tare > a (Percentage — 
it Description) ee ee a (Number of (Relative Learning (Average Time to (Times Performed in (Pay grade) (Rank Order of Automation) + 
(Actual Average Training Employees) Time) Complete) a month) Difficulty) 
Period) 
1 Ar 0.5 3 2 0.2 22. =r a) 2 50% 
8 Me /O 
aay BAL) 
2TH) 
BAL) 
2 AY TLEF ZAP 2 16 40 8 22 10 0% 
88 3),84) 
0/31) 
ADS ZT H(2) 
3 0.1 3 4 8 20 7 0% 
7/712 SAC) 
4 seclgi a 1 3 4 1 20 Hee) 6 50% 
/O 
re SAK) 
5 Alsi 0 0.2 3 1 0.1 22 ETEQ) 3 50% 
Ni ie /O 
aZ5 S34 SAC) 
2 H(7) 
BAN 
+8310lol a” 
6 2 16 40 4 1 At (3) 9 0% 
CHEt AYZSAt 
we) 
o0/3(1) 
MIAME! +e ee e(2) 
7 AAA Ol 0.2 3 4 4 are 5 0% 
Ss 
Ab qd) 
role acts, 
8 2478 {oll 1 3 1 O1 ein 4 50% 
mH e124 Som, 
9 ae 0.1 3 2 0.1 ET ee) 2 50% 
= i /O 
KO| IZE 3 AK(1) 
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B.  RFIDAS = ADAM 
A B C D E F G H I J 
Zt AA = 
eases fo eee eee 2} WRtO| 
whys Hoe cl eat ACH ste | Biol Aa eI 
oHe Te AsH Lro|> Ges 
+ Holl AQ AlZt Aggie AS St % 
Kroiz4el a ASE 42 Ald ano ale Al A 
Abed ext GAL a most ole : : eA (Percentage H| 2 
of At AIZE(h oe Sieeald Alzt Games (Pay grade) | (Rank Ord Aaohale 
2 (its) (Number of Learning (Average Performed (Rank Order uemeton) 
(Actual Average Time) : : of 
ms : Employees) Time to ina Dithicule) 
Training Period) Coniplete) month) ifficulty 
z = 22) 
Ma AaA\e S34 0.5 3 2 0.2 22 ZA 1 50% 
SA) 
PDA & AWDZAS B! aBaiy 
ae. 
2 ClOl HRAS Fe 1 3 40 8 22 a : 6 80% 
Me eon 
Mit *0/ ZS 2 H(2) 
3 Per 0.2 3 Z 2 20 as 2 50% 
23 BA(1) 

r KYL AWA S! COLE} ; 3 52 8 1 =a) 5 80% 
AE ee PMMA = A} ° 
aS MoS ato! oT H(2) ; 

5 eres 0.2 3 2 2 1 A 3 50% 

Ze 24 BAC) 
= Nase qzZE we P42) 
6 . 0.2 3 2 2 1 4 50% 
Bed BA(1) 
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OF 


RFID AS W EOF ws (ASW) 





















































D 
A B Cc E F G H I 
a ll seeraares 4 Bat edore SHS 2} Rt + Holl ACHE SHG Zt at = Holl st atzt See Zt Rt O| eee 
vs L ee! 2 
Silly) 3 wade? HPS Ae she Het ole AQ Alzt AQEIE Alzt ai Al LhOle eA Bente 
as TOCeSS ercentage 
at Description) 04] Af A] ZF (hrs) (Number of (Relative (Average Time to (Times Performed (Pay grade) (Rank Order of Aussie 
(Actual Average Training Period) Employees) Learning Time) Complete) in a month) Difficulty) 
SSC BAL 2, SfAt 1 
1 ‘ 3 5 20 0.5 7 isl 50% 
eoray= EA2 
ELOrSt 274] BAL 2, AAb 1 in 
2 pea 3 7 22 0.5 7 Hs) 5 ea 10 50% 
TS ToT , Tl 
EFOFAt GA QI 
3 are 05 2 5 0.08 7 BAR 1, E911 3 30% 
BUA 
SBA A 
4 pics 3 4 22 0.17 7 BAL 2, E22 9 50% 
Bessa 
Beals CHM io AAA 
5 S437] QL! CHAE 1 4 7 0.5 7 ~ Si 8 50% 
Eta AIS #91 
6 S4Bt74] At 0.5 1 3 0.3 7 BIA 4 2 0% 
BAP 1, SAb 1 
7 EFFORT o|S 0.5 3 3 0.3 7 at 1 0% 
ot 
SA 6, EF 1 
8 EPORAA ZH 1 8 3 0.15 7 - oie . 7 0% 
TI 
Be|ScHolAM BAL 2, SAE 1 
9 ; 0.5 4 3 0.2 7 4 50% 
=}2! (Company) E21 
2S 
aoe WAL 2, SAL 2 
10 #2B2414 0.5 6 4 0.2 7 aiake 5 50% 
Tl 
‘+ °l(Battalion) 
11 Scs7| 0.5 2 8 0.5 7 BAL 1, Z 2/4 6 0% 
Total 14 46 
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RFID A'S = ErOFe HHA (ASW) 


















































D 
A B Cc E F G H I 
nen 4 BA + Sote SHS Zt Rt + eo AtcHa Bhs Zt at ato | Bt Zt Patel 2} Batol ee 
4 x = 7 ASS 
= pita HPC 22 Sle Bos ole A Alzt AQSIE AlZt alt Ale Lol eA a ane 
TOCeSS ercentage 
Description) 04] Af A] ZF (hrs) (Number of (Relative (Average Time to (Times Performed (Pay grade) (Rank Order of Retonsen 
(Actual Average Training Period) Employees) Learning Time) Complete) in a month) Difficulty) 
SSC BAL 2, SfAt 1 
‘ 3 5 20 0.5 68 8 10% 
oy EA2 
ELOrSt 274] BAL 2, SAt 1 
3 7 20 0.5 68 9 10% 
FURAlAl EP 2, CHE 2 
Etorat Eat gl 
% s 0.5 2 2 0.08 68 BAL 1, E214 3 30% 
BUA 
LBA 
inne 3 4 16 0.17 68 BAL 2, E22 6 10% 
geass ua 
Hea|Sch HAA 3 
. 15 2 0.08 68 BAL 4 4 0% 
eat 
SAL 1, Ab 1 
EFokD o|= 0.5 3 3 0.08 68 2 0% 
E91 
EFORAZH GI 
oN ee WAL 6, AtAt 1 
MAMAS PDA 1 8 9 0.83 68 fe 7 80% 
se eFl1 
oe 
2B 
ons WAL 2, E912 
BSS 1 6 24 0.17 68 5 10% 
CHE] 2 
‘st 2 (Battalion) 
ool 0.5 2 3 0.5 68 SAA 1, Zl 1 1 0% 
Total 14 39 
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